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EXECUTIVE SUMMARY 



BACKGROUND 

In 1981» the Board of Education approved a new curriculum Idea, pilot tested 
since 1977, for Instruction In English Language Arts for kindergarten 
through eighth grade. The new curriculum, called the Instructional Program 
In Reading/Language Arts, (IPR/LA)» Integrates the teaching of skills In 
reading, listening, speaking and writing. Further, it breaks away from the 
traditional step-by-step buildup of skills from one grade to the next. 
Instead, comprehension and Integration of the basic skills become the 
centerpiece of all Instruction at all grade levels In reading and listening. 

According to the program's developers, the new curriculum differs from 
traditional ones In a number of ways. 



o In the ''old" approach, the student Is a passive practitioner of 
rote skills; In the new approach, the student becomes an active 
agent asking questions in advance about what Is to be read, 
predicting the outcomes of what is read, and chedklng the accuracy 
of this more active engagement with the text* 

o The old approach relies on a basal reader series from a single 
publisher which is uead along with the publisher's teacher guides 
and workbooks. The IPR/LA approach encourages the use of trade- 
books from a variety of publishers, wl th support materials being 
developed by curriculum staff and teachers from MCPS. 

o The old approach stresses reading mainly for facts (linked with 
the tradl tlonal tes ting for f ac tual recall). The IPR/LA approach 
teaches students to construct and evaluate their Interpretations 
of the text. Students learn to put together an understanding of 
the stoxry's overall structure (characters, plot development, reso- 
lution of the action, etc.), and then they expand on and evaluate 
this broader comprehension by pulling In similar stories or exper- 
iences of their own. 

o In traditional vocabulary developmen t exercises, pupils tend to 
collect words like so many marbles In memory. But, the IPR/LA 
student learns new words In a meaningful context and uses them In 
speaking, writing, and reading. 

o Traditional curricula focus mainly on one type of text, "narrative 
text." The IPR/LA Is designed to Include a variety of text types 
(narration, exposition, persuasion, procedure, drama, and lyric) 
which differ In the demands made on the reader. 



In 1980, the Department of Curriculum and Instruction (since reformulated 
Into the Department of Academic Skills) requested the Department of 
Educational Accountability (DEA) to design an evaluation plan for the 
narration component of the new curriculum In order to address the following 
questions: 



Curriculum Implemeutatlou: 

To what extent Is the curriculum being Implemented In the elementary 
schools? What conditions Influence the extent of Irapleraentatlon? Are 
the administrative supports for implementation adequate? 

Curriculum Effects: 

Does the curriculum boost reading scores for elementary school pupils? 
Does it do so equally for different types of pupils (reading-level 
differences, race differences, grade-level differences)? Does It 
enhance pupil attitudes toward reading? 

In Its Year 1 Report on what became known as "The Reading Study," DEA 
confirmed several suspicions about the progress of Implementation. That 
report cited teacher comments about Inadequate in-service training and the 
difficulty of using the curriculum with lower-level readers, and It called 
for a more systematic approach to implementing curriculum reform. The Year 
1 Report did not address the effects of the curriculum on pupils. 

This report concludes the Reading Study by updating the Irapleraentatlon 
findings from the last two years of the study, and by examining the IPR/LA 
curriculum's effects on pupil performance. This document (Volume I) 
presents a brief overview of the study design, methodology, findings, and 
recommendations. Volume II presents detailed documentation of the data 
collection and analytic procedures. 

OVERVIEW OF YEAR 3 FINDINGS 

Curriculum Implementation 

loplenentatiaa is advancing^ but slowly. By May of 1985, the curriculum 
was fully Implemented in only about 4 percent of the reading groups 
observed. About 45 percent of the reading groups studied were 
"partially" implementing the curriculum, but another 41 percent were 
only at the "beginning" level of implementation (rated on a four-point 
scale defined by the curriculum's authors in DAS). 

Student characteristics make a difference in level of ioplenentatioa. 

The IPR/LA is less well Implemented for lower-achieving students and 
students in the lower elementary grades. 

Teachers and schools aake a difference. Large variations were found in 
the level of implementation due to teacher/classroom conditions and 
school-level factors. 

Experience is not a good predictor of laplementation status. Even 
though the schools by 1985 had been using the new curriculum for a 
period of time that varied from three to seven years, implementation 
levels were not associated with the school's length of experience with 
the new model. 

Support is isproved, but aore focused training is needed. The IPR/LA 
curriculum materials are generally in place and seen as adequate in the 
schools. However, in-service training, while widespread and helpful, is 
still too general and too brief to meet many teachers' needs. 
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Effects on Pupil Perforinance 



IPR/LA boosts reading scores. Oyer a two-year period, the IPR/LA 
curriculum had a significant effect on pupil reading gains as measured 
by the CRT-N, Benefits were found for all students regardless of 
initial achievement level, race, or grade in school. Gains were greater, 
however, for higher-achieving students in the upper grade levels, 
possibly because the curriculum wr?5 hotter implemented for these 
students • 

No direct effect vas found on reading attitudes. No direct or 
consistent curricular effects on pupil attitudes toward reading were 
found. 

In summary, then, the IPR/LA curriculum appears to be delivering on its 
promise to provide higher-quality instruction for many MCPS students. 
However, the program remains less well implemented for lower-level readers 
and pupils in the lower grade levels. 

Further, the study documented a "snowball effect" of implementation on pupil 
reading performance. That is, higher-level readers get a fuller curriculum 
implementation and, since the implementation leads to better reading 
performance, in the end they benefit more than the. lower-readers by having 
received more of a good thing. Thus, unless implementation is strengthened 
at the lower achievement levels, the new curriculum implemented in its 
current fashion will have the effect, as time goes by, of expanding the 
performance gap between lower-level and upper-level readers. 

Based on these findings the following recommendations are made: 

RECOMMENDATION 1 

Ways for accelerating the implementation of the IPR/LA are needed. 
Teacher reports dating back several years suggest the need for more 
detailed, hands-on training in specific classroom procedures rather 
than overall orientation to the general IPR/LA curriculum. 

RECOMMENDATION 2 

Increased efforts need to be made to provide fuller implementation of 
the curriculum for all students. The IPR/LA was not designed as a 
program for able students alone. Ways need to be found for more 
adequately implementing the program with lower-achieving, early-grade 
students. 

RECOMMENDATION 3 

To echo the final recommendation from the Year 1 Report, MCPS needs • to 
tsk€i a more systematic approach to program implementation than has thus 
IfT-: bean seen, and to provide the resources to support such a plan, 
'w^rca ;appears to be no formal and consistently implemented long range 
plan for curriculum installation. And after the first stages of 
program initiation and implementation, there needs to be a more formal 
and explicit plan for program support and evaluation, including 
training and material resources. The findings of this report, 
combined with those from earlier studies, indicate that if a curriculum 
is merely delivered to the school house door, it either will not take 
hold or will take hold only slowly and unevenly. 
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Chapter 1 



INTRODUCTION 



A NEW IDEA FOR READING INSTRUCTION 

In 1981, the Board of Education approved a new curriculum Idea, pilot tested 
since 1977, for instruction in English Language Arts for kindergarten 
through eighth grade. The new curriculum, called the Instructional Program 
in Reading/Language Arts (IPR/LA), integrates the teaching of skills in 
reading, listening, speaking and writing. Further, it breaks away from the 
traditional step-by-step buildup of skills from one grade to the next. 
Instead, comprehension and integration of the basic skills become the 
centerpiece of all instruction at all grade levels in reading and listening. 

According to the program's developers, the new curriculum differs from 
traditional ones in a number of ways, 

o In the "old** approach, the student is a pa sive practitioner of 
rote skills; in the new approach, the student becomes an active 
agent asking questions in advance about what is to be read, 
predicting the outcomes of what is read, and checking the accuracy 
of this more active engagement with the text. 

o The old approach relies on a basal reader series from a single 
publisher which is used along with the publisher's teacher guides 
and workbooks. The IPR/LA approach encourages the use of trade- 
books from a variety of publishers, with support materials being 
developed by curriculum staff and teachers from MCPS. 

o The old approach stresses reading mainly for facts (linked vrith 
the traditional testing for factual recall). The IPR/LA approach 
teaches students to construct and evaluate their interpretations 
of the text. Students learn to put together an understanding of 
the story's overall structure (characters, plot development, reso- 
lution of the action, etc.), and then they expand on and evaluate 
this broader comprehension by pulling in similar stories or exper- 
iences of their own. 

o In traditional vocabulary development exercises, pupils tend to 
collect words in isolation like so many marbles in memory. But, 
the IPR/LA student learns new words in a meaningful context and 
uses them in speaking, writing, and reading. 

o Traditional curricula focus mainly on one type of text, "narrative 
text," The IPR/LA is designed to Include a variety of text types 
(narration, exposition, persuasion, procedure, drama, and lyric) 
which differ in the demands made on the reader. Appendix A 
presents definitions of each of these types of texts. 

In 1977-78, the MCPS Department of Academic Skills (hereafter noted as DAS, 
but known earlier as the Division of Academic Skills) began developing this 
new curriculum in 1977-78, starting with the units which focus on narrative 
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text. In-service training for teachers and staff and new materials, core 
books, novels, curriculum guides, and other supports were gradually made 
available to back up the implementation of the IPR/LA curriculum. A new 
series of pupil tests was developed, the Criterion-referenced Tests for 
Reading (CRT-N), to supplement the data obtained from the California 
Achievement Tes ts and, in particular, to assess more rdequately th^ new 
emphasis on reading for comprehension. The curriculim itself has been 
expanded, with the speaking and writing curricula buing developed and 
components covering exposition, persuasion, and procedure being added. 

EVALUATING THE NEW READING CURRICULUM 

This was the new curriculum idea, but is it working? Is the curriculum 
really being implemented according to the blueprint? Is the in-service 
training adequate? Are the required materials and administrative supports 
In place? And, finally, how does the new approach benefit pupil reading 
performance? 

Questions like these began to surface as early as 1980. By then, the 
narration component of the IPR/LA had been installed on a pilot basis in 15 
schools for several years. At the request of the Department of Curriculum 
and Instruction (a department since dropped in central office administrative 
changes), the Department of Educational Accountability (DEA) formulated an 
evaluation plan for the narration component of the new curriculum (the 
feeling was that it was premature to begin to look at other components of 
the IPR/LA as they were in the early stages of development). In 1981 DEA 
conducted a feasibility study across 18 elementary schools of that 
evaluation plan and its measuring instruments. 

Even though that early evaluation was only a pilot study, its preliminary 
findings brought into question the curriculum's implementation^. The feasi- 
bility study found that more adequate in-service training was needed and 
that the new curriculum was time consuming to implement. Early indications 
were that the curriculum was more difficult to use with lower-level readers. 
And finally, teachers seemed to be reluctant to relinquish their hold on the 
familiar basal reader series with its workbooks and grade-by-grade siequences 
organized so well by the textbook publishers. 

It was agreed to proceed with a three-year evaluation of the narration 
component of the IPR/LA curriculum beginning in the fall of 1982 (hereafter 
called the Reading Study), focusing on two basic issues: 

Curriculum Iiaplecientatlon: 

To what extent is the curriculum being implemented in the elementary 
schools? What conditions influence the extent of implementation? Are 
the administrative supports for implementation adequate? 



1 . The Design for the Seconds-Year Study of Elementary Reading Ins true tion. 
Department of Educational Accountability, MCPS, November, 1982. And, 
Reading S tudy; First-Year Report , Department of Educational Accounta- 
bility, MCPS, August, 1984. 
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Curriculum Effects: 

Does the curriculum boost reading scores for elementary school pupils? 
Does it do so equally for different types of pupils (reading- level 
differences, race differences, grade-level differences)? Does it 
enhance pupil attitudes Coward reading? 

In its Year 1 Report on the Reading Study, DEA confirmed several suspicions 
about implementation raised in the pilot study and other informal reports 
from the schools. That report cited teacher comments about inadequate in- 
service training and the difficulty of using the curriculum with lower-level 
readers, and it called for a more systematic approach to implementing 
curriculum reform. The Year 1 Report did not address the effects of the 
curriculum on pupils. 

This report concludes the Reading Study by updating the implementation 
findings from the last two years of the study, and by examining the IPR/LA 
curriculum's effects on pupil performance. This document (Volume I) presents 
a brief overview of the study design, methodology, findings, and recommenda- 
tions. Volume II presents detailed documentation of the data collection and 
analytic procedures. 

OVERVIEW OF YEAR 3 FINDINGS 

The findings here summarize the study's results up through the 1984-85 
school year. Several conditions indicate that despite the one-year period 
of analysis between final data collection and the current report, last 
year's findings are not outdated. The reader will find that certain out- 
comes reported as early as the pilot study persist in the latest data. 
Also, the length of time schools had been using the curriculum was found to 
bear no relationship to curriculum implementation levels. Thus, the latest 
findings remain important for current planning. 

Curriculum Implementation 

Implenentation la advancing, but slowly. By 1985, the curriculum was fully 
implemented in only about 4 percent of the reading groups observed. about 
45 percent of the reading groups studied were "partially" implementing the 
curriculum, but another 41 percent were only at the "beginning" level of 
implementation (rated on a four-point scale defined by the curriculum's 
authors in DAS). 

Student cbacacteristlca make a difference in level of iiapleaentation. The 

IPR/LA is less well implemented for lower-achieving students and students in 
the lower elementary grades. 

Teachers and schools aake a difference. Large variations were found in the 
level of implementation due to teacher/classroom conditions and school-level 
factors. 

Experience is not a good predictor of iapleraentatlon status. Even though 
the schools by 1985 had been using the new curriculum for a period of time 
that varied from three to seven years, implementation levels were not 
associated with the school's length of experience with the new model. 

Supi^ort is Iflproved, but aore focused training is needed. The IPR/LA 
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curriculum materials are generally In place and seen as adequate In the 
schools. However, In-^servlce training, while widespread and helpful, Is 
still too general and too brief to meet many teachers' needs* 

Effects on Pupil Performance 

IPR/LA boosts readiug scores* Over a two-year period, the IPR/LA curri- 
culum had a significant effect on pupil reading gains as measured by the 
CRT-N. Benefits were found for all students regardless of Initial achieve- 
ment levely race, or grade In school. Gains were greater, however, for 
higher-achieving students In the upper grade levels, possibly because the 
curriculum was more fully Implemented for these students. 

No direct effect found on rcsading attitudes. No d.lrect or consistent 
currlcular effects on pupil attitudes were found. 

In summary, then, the IPR/LA curriculum appears to be delivering on Its 
promise to provide higher-quality Instruction for many MCPS students. 
However, adaptations In the method and/or more Intensive In'-servlce training 
may be needed to make the new approach more successful with' low-achieving 
pupils. Also, more lengthy and focused In-servlce training Is needed to 
accelerate the Implementation of the IPR/LA. 

What follows In this report Is a discussion of the Reading Study's methods 
In Chapter 2. A more lengthy discussion of the Implementation findings Is 
found In Chapter 3 as well as In Appendix A and B of this report. Chapter 4 
describes In more detail the curriculum's effects on pupils, and Chapter 5 
concludes with several recommendations arising from the Reading Study's 
findings. 

To facilitate the reading of the lengthy and at times complex findings of 
the study, the details of the study's methods, the specific descriptive data 
from various analyses, and the statistical tests of the data have been 
removed from the main text and enclosed In a separate document. Volume 2 of 
the Reading Study. Readers familiar with descriptive and Inferential 
statistics are referred to Volume 2 for specific analyses supporting the 
findings summarized here In Volume 1. 
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Chapter 2 



EVALUATION METHODS 



The Reading Study is a compreheaslve evaluation of the curriculum implemen- 
tation process and its outcomes. The measures used lacluded staff 
interviews and questionnaires, pupil testing across several years, and a 
complex classroom observation system. The analysis examined data at the 
levels of individual pupils, reading groups within classrooms, and the 
teacher. Because of Its complexity, an overview of the study design is 
needed to understand fully the findings of the Reading Study. Thus, in this 
chapter there appears a description of the sample of schools and pupils 
included in the study, the measures used for the s tud> , and the 
interpretation of these measures in the analysis. Note particularly the 
manner in which the observation data were sui>marized to produce an 
"Implementation score" for reading groups within classrooms. 

SAMPLE 

In 1982, a sample of 20 MCPS elementary schools was selected for the three- 
year reading study. The sample was representative of the MCPS elementary 
schools regarding achievement levels and length of time the schools had been 
exposed to IPR/LA* Schools from each of the three administrative areas were 
included and are listed In Table 2.1. 



TABLE 2.1 

Sample of Elementary Schools Included In the Reading 
Study, Grouped by Achievement Level and Years 
of IPR/LA Curriculum Implementation 
(in 1982) 



Years Implementing 


Achievement Level 




Curriculum 


Below County 


Above County 


Total 




Mean 


Mean 




Since 1981-82 


Broad Acres 


Potomac 






Maryvale 


Fallsmead 






Rolling Terrace 


Sherwood 


6 


. From 1980-81 


*Bcall 


Seven Locks 






Fields EU>ad 


Cedar Grove 






Viers Mill 


Greenwood 


6 


Prior to 1980 


Poolesville 


Bannockburn 






Clarksburg 


Laytocsville 






Gleoallaa 


Kemp Hill 


6 


Nonimplementing Schools 




Bethesd:^ 








Farmland 


2 








20 


*Beall consolidated with a school In this category of implementation. 
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within each school, four classes (two first grade and two fourth grade) were 
randomly selected for study the first year. Classrooms at these two grade 
levels aere selected to allow comparisons of program implementation and 
student outcomes at the primary and upper elementary grades. The 
approximate].y 1800 students contained in these classes during Year 1 were 
followed for three years as they picogressed from first to third grade or 
from fourth to sixth grade. As these students moved into different 
classrooms in Year^ 2 and 3, their classmates and teachers were also 
included in the study. Due to resource constraints, it was not possible to 
follow students who changed schools within the county. 

MEASURES 

Curriculum Implementation 

Formulating a set of instruments to measure the IPR/LA curriculum process 
was crucial to the first objective of the Reading Study since no such 
measure existed during the early years of the curriculum. During the 
planning year (1980) and the pilot study (1981), DEA developed the 
instruments and methods described below. 

Classrooa Observaliloas. Using a direct classroom observation measure 
modeled after the specifications of the IPR/LA curriculum, observers 
trained by DEA recorded the frequency of selected classroom events. The 
main categories of events recorded by the observation instrument were as 
follows: 

o Comprehension activities 

o Teaching strategies 

o Narrative materials usage 

o Vocabulary development 

o Grouping practices 

o Decoding activities 

Detailed descriptions are provided in Table 2.2. 

Classroom observations were conducted at unannounced times at three periods 
during the school year (fall, winter, spring). During an observation 
period, data were collected for each reading group in the class. 

Volume II, the technical appendix, provides a detailed description of the 
data collection procedures and the items used on the classroom observation 
ins trument. 

Questionnaires and InterTTlevs. The study also collected extensive 
questionnaire and interview data from school staff during each of the three 
years concerning the implementation process and its impact. Classroom 
teachers, media specialists, resource room teachers, and special education 
teachers completed questionnaires. Teachers who participated in the 
observations, principals, and reading specialists were Interviewed. The 
interviews and, in less detail, the questionnaires provide information on 
three aspects of the implementation process central to the main study 
issues: 



TABLE 2.2 

Classroom Observation Items for Six Major Curricular Categories 



Currlcular Classroom Observation Items 

Category Teacher Activities 



COMPREHENSION 
ACTIVITIES 



TEACHING 
STRATEGIES 



NARRATIVE 
MATERIALS 
USAGE 



VOCABULARY 
DEVELOPMENT 



GROUPING 
PRACTICES 



DECODING 
ACTIVITIES 



Definitions/Examples 



Develop understanding of gist 
of discourse 

Develop understanding of over* 
j>n fitructore of discourse 
Use enridoeat/extendisig acti- 
vities 



Encourage studesit discussion 



Encourage students to predict 
while reading a selection 
Use open-eoded questioos to 
promote critical thinking and 
discussion 

Use varied atrategies 



Clearly 
read ing 



establish purpose for 



Relate text to student's back- 
ground knowledge and experi- 
ence 

Avoid round robin oral reading 



Emphasize tradebooka 
Use experience stories 



Rely less on basal readers and 
the accompanying workbooks and 
dittos 

Present and develop selected 
words/concepts in oeaningful 
context 

Encourage word use 



Use multiple grouping patterns 



Use context clues to help 
students decode unfamiliar 
words 

Discourage student use of 
isolated pboneses to sound out 
words 

Avoid isolated phonic elenents 

In helping students decode 
unfamiliar words 



Gist is what the story is mostly about, the 
main idea, theme, best title, conclusions. 
The overall structure of narrative discourse 
includes characterization» plot, and setting. 
Some enrichment/ extending activities are: 
dramatize story, make poster of favorite 
character's adventure, rewrite story with 
new ending, construct mural/model. 

Student discuasion occurs among students 
and teacher rather than in teacher-directed 
question/answer format. 

Prediction questions include: What will 
happen next? What will the unit be about? 
Open-ended qneationa are, for example, **how** 
and ""why** questions rather than literal 
questions. 

Varied strategies include webbing, brain- 
storming, active listening, paired talking, 
discussion plays, and language experience. 
Examples of establishing purpose are: Read 
this selection to find out..., listen for 
rhyming words in the passage. 
Experience questions include: Did you 
ever...?. How would you feel if it happened 
to you? , Have you even been to ... ? 
Round robin oral reading is students reading 
passages aloud in turn. 

Tradebrooka are library books. 
Expedience storiea are student-authored 
accounts of an individual or group experi- 
ence. 

Baaala are a series of readers developed by 
publishers. 



Meaningful contexts include presenting words 
in phrases, seatences, or passages rather 
than lists. 

Examples of word use are: Student.*; use words, 
teacher asks questions relating to vords. 

Grouping patterns include student interest 
groups , he terogeneous groups , whole-class 
grouping, homogeneous groups, and individual- 
ized groups. 

Context clues are semantic, syntactic clues 
(6*g*i pictures, surrounding words/senten- 
ces) . 

Isolated phonenes are individual letters. 



Isolated phonic elements are letter /sound 
relationships (e.g*, blends, diphthongs). 



EKLC 



15 



o Administrative supports 
o Instructional practices 

o Opinions about curriculum Implementation and Its Impact 
Pupil Outcomes 

At the outset of the Reading Study, there were no systemwlde end-of-year 
pupil measures specific to the goals and style of the new IPR/LA approach. 
The only data collected systemwlde came from the California Achievement 
Tests administered in Grades 3, 5, 8, and 11. These were judged by the 
program's developers to provide only a partial look at reading achievement. 
No data were collected on attitudes toward reading, another area that the 
developers of IPR/LA felt would be affected. To fill in the gap in achieve- 
ment testing, DAS developed a new series of pupil tests to assess the 
reading comprehension goals of the new curriculum. To assess reading 
attitudes, DEA formulated a pupil questionnaire. 

Student Reading Tests. The Criterion-referenced Tests for Reading (GRT-N) 
were administered at the end of each school year to record pupil progress. 
Reading performance was asses sed at the beginning of each year on the 
reading subtest of the G^'^fomla Achievement Tests. The exception to this 
schedule was in Year I ;en the Woodcock Reading Tests were used as a 
pretest for first-grade Sc.jents and the OELBIT test, a test which resembles 
the CRT-N, was used as a year-end measure for first- and fourth-grade 
students. 

Attitude Surveys. Student attitudes toward reading were measured during the 
fall of each year with a brief (16 item) inventory administered to all of 
the students in the study. A description of these items is included in 
Volume II. 

Deriving Implementation Scores From Classroom Observations 

The classroom observation instrument provided many items covering the 
various curriculum areas observed. To simplify tills volume of information, 
an overall "implementation score" was developed in much the same way that, 
for example, pupil math test items are summarized into a single math score. 
Working in collaboration with the curriculum developers in DAS, DEA staff 
formulated the following scoring system: 

First, the various observation items were separated into the six main 
areas of the IPR/LA curriculum, a process similar to identifying sub- 
tests on an achievement test* These six categories and their observa- 
tion items, listed in Table 2.2, provide a more detailed description of 
the curriculum's recipe than the overview given in Chapter 1. 

Second, for each of the curricular areas, DAS specified the patterns of 
items which most exemplified, or least represented, the curriculum as 
designed. This process produced a O-to-7 rating in each of the six 
areas. Details of this process are included in Volume II. 

Third, while the seven-point scale rated relatively high or low imple- 
mentation across the six areas, these ratings were neither directly 
comparable nor in terpre table. Thus, DAS reduced these ratings to a 
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four-point scale with roughly equivalent interpretations for each scale 
point across the six curriculum areas. The scale points for curriculum 
implementation were: 

1. Not implemented 

2. Beginning to implement 

3. Partially implemented 

4» Fully implemented 

Details of the translation from the seven-point to the four-point scale 
are included in Volume II. Using this scale, each of the six areas 
could be scored and the scores could be roughly compared to each other. 

Fourth, the scores for six curricular areas were combined into an 
overall implementation "total score." The six scores were not, how- 
ever, simply averaged together. According to the curriculum authors in 
DAS, certain of the areas are better indicators of IPR/LA implementa- 
tion. Thus, DAS provided a weighting system for combining the six areas 
according to their re la tive im por tance in the overall curricular 
approach. The weighting scheme is more suitable for judging the IPR/LA 
in grades three through six, according to DAS, than it is for the lower 
elementary grades where decoding activities may be more prevalent. 
These weights are as follows: 



Curriculum Area Percentage 

Comprehension activities 35 

Teaching strategies 23 

Narrative materials usage 20 

Vocabulary development 12 

Grouping practices 6 

Decoding activities 2 

100 % 



These weights mean that the the best way to get a high implementation 
score is for teachers to engage in comprehension activities and use a 
variety of teaching strategies and materials as found in the IPR/LA 
recipe. By contrast, the grouping practices or the decoding activities 
do not contribute much in the overall implementation score. The 
weighted average of the six curricular areas produced the four-point 
implementation total score analyzed in Chapters 3 and 4. 

UNIT OF ANALYSIS 

The Reading Study uses two basic units of analyses. For most questions 
regarding implementation, the reading group within the classroom is the unit 
of analysis. This unit was selected over other possible candidates such as 
the total classroom or the individual student because DEA felt it provided 
the most accurate reflection of how teachers typically organize the bulk of 
their reading instruction. For some questions, however, these reading group 
scores are averaged to provide a single score characterizing teacher 
performance. 



For questions regarding student outcomes, both achievement and attltudlnal, 
the Individual pupil Is the unit of analysis. 

Finally, for questions regarding the relationships between Implementation 
and pupil achievement, these units are combined. Specifically, each pupil 
Is given an average score representing the level of Implementation of the 
reading groups In which he or she participated during the last two years of 
the Reading Study. 

This discussion on unit of analyses completes the Methods chapter. What 
follows In Chapter 3 is a report on the implementation levels observed in 
1985 and several analyses examining various group factors which make a 
difference in curricular Implementation. Chapter 4 reviews the pupil 
outcomes from the IPR/LA curriculum^ and Chapter 5 follows with the 
conclusions and recommendations. 
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Chapter 3 



CURRICULUM IMPLEMENTATION 



The first goal of the Reading Study Is to Identify whether and to what 
extent the IPR/LA curriculum Is being Implemented. Specif Ically, the study 
was designed to address the following questions regarding the status of the 
IPR/LA: 

To what extent Is the curriculum being Implemented In the 
elementary schools? What conditions Influence the extent of 
Implementation? Are the administrative supports for Implementa- 
tion adequate? 

To answer these questions, the following series of analyses was undertaken. 
First, data on Implementation levels were examined to measure the extent to 
which the IPR/LA was In place In the schools studied during 1985. This 
examination looked not only at the overall Implementation of the program but 
also at various curriculum components — comprehension activities, teaching 
strategies, use of narrative materials, vocabular}^ development, grouping 
practices, and decoding activities. 

Second, to see whether the new approach appeared to be working In some 
situations and not In others, analyses examined whether the degree of Imple- 
mentation varied across schools, teachers or pupllc. Certain characteristics 
were selected which had previously been found in the literature to affect 
Implementation of new programs or had been reported by MCPS teachers as 
Influencing the delivery of IPR/LA. 

Finally, analyses examined whether staff were receiving the necessary admin- 
istrative supports for program implementation. Of particular concern was the 
question of whether sufficient training, materials, and monitoring were 
provided. 

PROGRAM IMPLEMENTATION 

Classroom observations indicate that, judging from the 1985 data, the 
curriculum is fully implemented in only a handful of elementary schools. 

Figure 3.1 below shows that about 4 percent of the reading groups observed 
in the third and sixth grades are fully implementing the curriculum; it is 
partially implemented in 54 percent of the sixth-grade and 39 percent of the 
third-grade groups. It is at the "beginning level" of implementation in 
about half of the third-grade groups and in one-third of the sixth-grade 
groups. 

Exam ips. ^ ' <:i rf the six major curriculum components—comprehension 
activitie^^ c^tsching strategies, use of narrative materials, vocabulary 
develop!A^i.L»\ grouping practices, and decoding ac tivi ties — indica tes 
important . i nces in their levels of implementation. And, more important 
component^ ^ -^r? necessarily better implemented than less important ones 

(see Figure For example, while comprehension activities are seen by 

the program's developers to be the most important component of the 
curriculum. Figure 3.2 shows that they are Implemented less completely than 




vocabulary development, the component ranked fourth out of six in 
importance. 



FIGURE 3.1 

Percentages of Third- and Sixth-Grade Reading Groups 
at Each Stage of Implementing the IPR/LA Curriculum in 1985 




Not Begin Partial Full 

Level of Implementation 



Figure 3.2 presents third- and sixth-grade reading group average 
implementation scores for these six components, laid out from left to right 
in order of decreasing importance. Details regarding the implementation 
status of each of these six components are presented in Appendix B. 



FIGURE 3.2 

Average Implementation Level of Each Curriculum Component 
for Third and Sixth Grade in 1985 




FACTORS AFFECTING CURRICULAR IMPLEMENTATION 

The study also looked at a number of factors which have previously been 
found to affect curriculum implementation. Roughly speaking, these factors 
fall into three categories: student differences, school differences, and 
teacher differences. The Reading Study looked at the extent to which each of 
these affects the implementation of IPR/LA. 

Student Differences 

Earlier examinations of the IPR/LA suggested that the curriculum was easier 
to implement or more suitable with older and higher-achieving students. 
Analyses of the data confirm and extend these findings. 

Figure 3.3 shows that each successive grade level averages somewhat higher 
overall implementation scores than the last. This analysis also shows (see 
details in Volume II) that the magnitude of the differences across grades is 
greater than the average magnitude of the differences between schools. In 
other words, the differences in implementation across grade levels within a 
school tend to be greater than the differences between schools. 
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FIGURE 3.3 

Grade Level Differences in Curriculum Implementation 
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Teachers commonly subdivide their pupils Into several reading groups of 
different reading proficiency levels. The analysis shows that the 
curriculum Is not Implemented to the same extent across these groups. 
Figure 3.4 below shows that within classrooms at all four grade levels, the 
curriculum Is better Implemented for higher- than for lower-achieving 
students. 

The average Implementation levels for the below-, on-, and above-grade- level 
reading groups are displayed in Figure 3.4. The analysis (detailed in 
Volume II) indicates that the below-grade-level reading groups have a 
significantly lower curriculum implementation average than the on-grade- 
level groups. The above-grade versus on-grade contrast was not 
statistically significant. Across all grades, the below-grade-level groups 
averaged less than the above-grade-level groups. 
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FIGURE 3.4 

Implementation Levels for Within-class Reading Groups Which Are 
Below, On, or Above Grade Level In Reading Performance 
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Teacher and School Differences 



The Reading Study also examined whether implementation differs among schools 
and, within these schools, among teachers. The analyses show that both of 
these factors influence the level of implementation. (More detailed analyses 
of teacher and school effects are presented in Volume II.) 

Specifically, teachers account for a significant portion of the implementa- 
tion differences across their reading groups; and schools, in turn, account 
for a significant portion of the variation of their teachers' implementation 
averages. These findings suggest that curriculum implementation is at least 
a two-stage process involving both overall school and individual teacher 
influences; 1) teachers deliver the curriculum to their reading groups, and 
all influences ultimately are channeled through the teacher-classroom 
combination; and 2) schools and school-related features influence the 
teacher by way of preparation, support, staff differences, school climate, 
.and other school-related factors such as school achievement level. 
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The Reading Study was designed to provide detailed data on program implemen- 
tation, but unfortunately does not provide details on the multitude of 
teacher and school factors which potentially make a difference in the 
curriculum delivery process. Thus, while it is possible to specify here how 
important teacher factors and school factors are, the specific characteris- 
tics which matter the most cannot be identified. However, one factor can be 
noted which does not make a difference — the number of years that the program 
has been implemented at a given school. 

The results in Figure 3.5 indicate no significant differences between the 
teachers in schools using the curriculum for different numbers of years. 
Teachers in schools with a three-year experience with the curriculum average 
slightly, but not significantly, higher than others, and those in schools 
new to the curriculum are somewhat lower. Yet, those with two years of 
experience average lower than the schools new to the curriculum. In 
general, however, the groups with three or more years appear slightly, but 
not significantly, higher in implementation levels than the others. 

This finding appears at first glance to violate the dictum, '"Practice makes 
perfect." However, early signals from the Year 1 Report suggested that many 
teachers were dissatisfied with their in-service training on the curriculum, 
having received only five hours or less of training. And, data reported 
below from the teacher interviews indicate that most teachers would like 
further training, be it more in-service, classroom demonstrations of the 
curriculum or visits to model classrooms. Thus, the mere availability and 
use of the curriculum in schools does not suffice for successfully 
implementing the curriculum. 

FIGURE 3.5 

Mean Curriculum Implementrition Levels Grouped by 
Length of Time Schools Had Been Implementing the Curriculum 
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ADMINISTRATIVE SUPPORTS FOR CURRICULUM 



In order for schools and teachers to implement any curriculum, they need the 
following adirlnls tra tlve supports: 

o In-service training for staff 

o Other types of assistance for staff 

o Curriculum materials which are available, received in a timely 

manner, and appropriate 
o Consistent monitoring of curriculum Implementation 

The study assessed the extent to which these supports are present and 
adequa te. 

In-service Training 

Overall, about 90 percent of the staff say that they had received In- service 
training on IPR/LA during the school year and that this training was helpful 
in implementing the new reading curriculum. However, there are some 
indications that the training is too superficial. For example, about one- 
third of the staff feel that this in-service training was not sufficient for 
implementation of IPR/LA because the content of the in-service training 
tended to be general and introductory rather than specific in nature* Staff 
report that the training they received more often Included such general 
topics as program overview, objectives, and organization of the instruc- 
tional guide rather than more specific topics like selection of instruc- 
tional materials. Interpretation and use of CRT results, or use -of illustra- 
tive units. Thus, while in-service training is generally available and 
helpful, it is not sufficiently specific for helping some staff to Implement 
fully the new curriculum. 

Other Types of Assistance Needed by Teaching Staff 

Virtually all teaching staff (98 percent) express a need for some type of 
additional assistance in implementing the curriculum. Many of the respon- 
dents list the following needs: 

o Time to read materials, plan, and learn more about IPR/LA (83%) 

o Materials for teacher use (e.g., lesson plans, minlunlts) (73%) 

o Demonstration lessons using IPR/LA objectives, strategies, and 
materials (67%) 

o Opportunities to visit classrooms where IPR/LA is successfully 
Implemented (55%) 

o In-service workshops (47%) 

o Individual sessions with specialists to plan/discuss IPR/LA 
(44%) 

o MCPS in-service courses (35%) 



As with their respocr^^cs i^-^.garding the content of in-service training, staff 
appear to be more interested in specific, concrete assistance than general 
in-service courses or workshops that give only an overview of the 
curriculum. Requests for additional assistance appear more frequently with 
lower gx*ade level and special education teachers, lending credence to the 
findings above concerning implementation differences across reading 
performance levels. 

Curriculum Materials; Availability and Other Concerns 

Teachers generally report that curriculum materials were available and were 
received in a timely manner. Of the materials surveyed (overview manuals, 
instructional guides, core book lists, basal correlation sheets, scope and 
sequence charts, CRT^N and novel tests), basal correlation sheets are least 
available; but only 20 percent of the staff report a problem with 
availability of these materials. Thus, the availability of materials does 
not seem to be a significant barrier to implementing the curriculum. 

Ninety percent of the staff using these materials find them to be helpful. 
On the other hand, when asked about any difficulties they are having, at 
least half of the respondents also report some problems with the 
instructional guides, the core book lists, and the CRT-N. Half of the 
reading specialists and principals report problems with the instructional 
guides, primarily regarding their lack of organization. Seventy percent of 
staff (primarily those Involved in direct instruction) report some problems 
using the cr>re book list; roughly half of those reporting problems listed 
the following concerns: 

o Books were out of print or otherwise unavailable. 

o Not enough books were listed at different levels within grade. 

o Not enough books were listed for Some forms of discourse. 

About half the staff report problems using the CRT~N. The most common 
complaints are that the test scores are not received in a timely manner 
(27%) and that the difficulty level of the test is not appropriate for 
students (33%), in most cases because the grade^level test is too difficult 
for students, especially in the lower grades. (Recent changes In 1986 for 
returning CRT data to teachers earlier and for assigning pupils to their 
appropriate test levels were implemented to overcome these difficulties.) 

In summary, although curriculum materials are generally available, staff 
have some specific concerns about these materials which require remedy: 
the lack of organization of the instructional guides and the unavailability 
of appropriate core books* 

Monitoring Curriculum Implementation 

Roughly two- thirds of the principals report that guidelines are available 
for monitoring implementation of the curriculum; these guidelines are pri- 
marily provided by the area office. Generally, monitoring is the respon- 
sibility of the school's reading specialist (82%) and/or principal (61%). 
Principals and reading specialists most often note a lack of time (56%) and 
teacher resistance (39%) as difficulties they face in monitoring 
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imp lemen ta t icn . 



It Is likely t:>at principals and reading specialists face difficulties In 
monitoring slmll^^r to the problems which teachers report In following the 
curriculum, namely a lack of specificity In the training materials. The 
avallablll^ of a standardized and simplified monitoring form together with 
the training necessary to use It would likely assls t principals and 
specialists in producing higher and more even implementation levels within 
their schools* 

SUMMARY OF IMPLEMENTATION FINDINGS 

Analysis of the latest data show that the curriculum is only modestly 
implemented in the elementary schools* Implementation is beyond the 
beginning level in only about half of the the reading groups studied. Since 
the schools' years of practice with the curriculum bear little relationship 
to implementation levels, these 1985 data most likely apply to the current 
school year. While there are no hard and fast standards for how long it 
should t^ke for a new program to be fully implemented, it seems reasonable 
to suggest that the progress shown in implementing IPR/LA is far from 
impressive* In fact, given the pace of new findings emerging in the field 
of reading research, it may be tempting to modify the present curriculum 
before many schools have fully adopted it. 

One finding that has consistently emerged from studies of IPR/LA is that the 
program is less well implemented with lower level readers and pupils in the 
lower grade levels. The reasons for this are not clear. However, the data 
do show that the same teacher may use the currl'^^ilum to varying extents with 
groups of different reading levels* This suggests that at least some 
teachers who know how to implement the curriculum f^ ; able readers either 
find the same material unsuitable for their less able raadatu, or are not 
sufficiently trained in applying the new curriculum to their 2.ower level 
readers. Despite this finding, the data do not allow us to decide 
definitively whether tfc . problem lies in the design of the program, the 
unwillingnass of teachers to use i« with less able students, both of these 
factors, or some as yet undiscovered condition. Suffice it to say that 
there appear to be systematic differences in program implementation which 
result in lower-achieving students and students in the lower elementary 
grades getting a smaller "dose of the program. This is not consistent with 
the program as designed* 

The analyses also show that both teachers and schools make a difference in 
program implementation* Although it is not possible to say conclusively 
what it is about th^^e factors that make a difference, it is known that the 
school's length of u^me using the program does not provide a satisfactory 
answer* 

The data on adminiSL/.^kiilve supports at least offer some suggestions on ways 
to improve the IPR/LA implement;: ^lon. Teachers* reports indicate that more 
in-service training is needed; further, what is needed is not general 
training, but training addressing specific problems or components of the 
curriculum* The present study suggests that two topics requiring immediate 
attention are implemctnting the curriculum with young and lower-achieving 
students and using comprehension activities* Other topics will no doubt 
assume increased impf;^rtance for individual S'^^'ools and teachers* 



Chapter 

IPR/LA CURRICUtU/A Ef^^cM^ ON PUPILS 



Th£ secoad goal of the Reading StudC^ 15 to assess Its effect on student 
achievement and attitudes tovarti Ceo^Alcvg. Specifically, the study was 
designed to address the following ^u&s^%or\9 regarding progran: effects: 

Does the curriculum boost the. rea<lling scores for elementary 
school pupils? Does it do so equally for different types of 
popils (reading level differeaccs, race differences, grade level 
differences)? Does It enhance pu^il altitudes toward reading? 

To answer these questions, analyses '^ere conducted of the correlations 
between the curriculum ImplemeB ta tlon measures discussed In the previous 
cto^ter and student achievement and attitudes. These correi? t;lons were 
adjusted statistically, where necessary, in order to get at the direct 
coonection between the variables and screen out their overlap with other 
measures* (Details of the statistical procedures used are presented In 
Volume II.) It should be noted that this "screening-out" process, together 
with some inevitable measurement error, produce more conservative estimates 
of the cnrriculum's effects. This means that where effects are discovered^ 
such as those reported below, tliey represent Important connections between 
the variables in question which uuay be stronger than the correlations alone 
indicate. 

CUmaiJIJDM EFFECTS ON READTbjG OUT.COHES 

Research has shown that the most important Influence on a pupil's reading 
performance is the pupil's reading ability at an earlier point in time. The 
analysis presented here takes this fact into account and then identifies how 
much sore the curriculum adds to pupil performance apart from the pupil's 
previoas reading level. Specifically, the analyses of the effects of 
curriculum implementation on reading achievement examine the linkages 
between several variables: initial reading level at the beginning of the 
second or fifth grade (pretest), race, curriculum implementation level, and 
final reading scores at the end of the third or sixth grade (posttest). In 
doing siiese analyses, the primary measure of achievement is pupil perform- 
ance cm t3»B CRT-N. The major findings are as follows: 

Bl^^ levels of cnrricultio Impleaentatlon lead to higher pnpll reading 

Level of curriculum implementation (averaged over a two-year period) 
correlates .08 with reading gains for lower elementary and .11 for 
upper elementary pupils. These correlations, though small, are statis- 
tically significant. The curriculum effect is slightly stronger in the 
upper grades where implementation levels are somewhat higher. The 



1. Correlations between measures range on a scale from O.O (no association 
at all) to 1.0 (a perfect correspondence between the two measures). 
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basic correlations between Implemontation level and subsaquent reading 
performance, unadjusted for other relationships, ate as high as .36 In 
In the upper elementary group. Bub this figure needs to be adjusted 
statistically for the correi&>tioo of *31 between Implementation and 
prior reading performance. This an^ilysls was conducted on a sample of 
555 lower elementary and 459 uppdr elementary pupils who had implemen- 
tation and achievement data from the last two years of the Reading 
Study. 

There are no race differences in the curricolum's effect on reading 
gains* Majority and minority poplls benefit essentially the sase. 

There are no slgnlflcav i\7ce differences In the curriculum's effect on 
gains. The correlation la question here is less than .01. Any 
observed race differences Ir^ outcome scores are due to race differences 
in pretest, not to race differences per se in the curriculum exposure. 

The curriculua's direct effect on z^eading. gains is about the saiae for 
pupils at all reading levels. 

Regardless of initial reading group level (top, middle or bottom third 
of the class) the direct effect of implementation level on achievement 
was approximately the same. This indicates that slower learners profit 
as much from a given level of IPR/LA implementation as their more rapid 
learning class ma tes. 

The prograa has vhat aight be called a "snowball effect. T^hat is, 
higher-achieving students oay in t2se end benefit soaevhat nore froa the 
prograa than others, especially in the upper grades. 

This snowball effect comes abouc through the cumulative operation of 
two factors: the direct effect of the curriculum on gains as noted 
above, and the indirect effect of reading ability on how much implemen- 
tation a pupil receives. First, there is the direct effect of the 
curriculum on reading gains described above in the first finding — 
pupils who get a better curriculum dosage get higher reading gains. 
Second^ there is the finding froa Chapter 3 (reconfirmed in the analy- 
sis here) that, higher achievers get a better dosage of the curriculum 
than lower-achieving students. Taken together, the result is that those 
who get more of the curriculum — the higher achieving students in the 
upper grades — profit more from it. This higher benefit is not because 
the curriculum works better for them (as noted in the just previous 
finding), but because they get a fuller dose of a good thing. The 
outcome is similar to piliag interest income on top of principle. Even 
though all pupils have the same ''interest rate" (the coefficient 
linking curriculum to gains), those with more "money" at the outset 
accrue money faster than those who started with less. This is the 
"snowball effect," i.e., "the rich get richer." Thus, unless implemen- 
tation is strengthened at the lower achievement levels, the new curric 
ulum implemented in its current fashion will have the effect, as time 
goes by, of expanding the differences in reading performance between 
lower-level and upper-level readers. 



PUPIL ATTITUDES TOWARD READING 



Pupil attitudes toward reading were assessed as a supplement to the study of 
reading performance* Reading for leisure and enjoyment is a valuable by- 
product of school learning and thus deserves study as a potential outcome of 
the IPR/LA curriculum* A.I80, the assumption was that pupils who enjoy 
reading would read more and that any curricular effects on attitudes would 
thereby provide more leverage on reading improvements in the future. 

Four reading attitude scores were measured with a brief questionnaire asking 
pupils about their liking for readin;^ and activities related to reading. 
Thece scores and their meanings are aa follows (technical details of the 
scoring process are included in Volume II): 

LIKES TO READ 

The pupil likes to read, choos^c to read of ten, reads much in school^ 
and says reading is a favorite subject. 

PERFORMER 

The pupil likes to act out what is read and likes to read aloud, talk 
about books » and tell stories. 

GOOD READER 

Thta pupil claims to be a good reader; reads difficult books and 
newspapers. 

WRITER 

The pupil enjoys writing, answering questions about what is read, and 
tnaking rhymes. 

Using an analysis similar to that for the academic outcomes, the study 
found the following: 

There is no systeraatic evidence linking curriculum isplecientatio^ 
levels to improved attitudes to«rard readiisg. 

There is no evidence that the reading curriculum has any consistent or 
sustained effect on pupil attxtudes toward reading. The few relation- 
ships between curriculum io piemen tation and reading attitudes found in 
the analysis were very small and did not replicate across grade levels 
or years. 

SUMMARY OF FINDINGS REGARDING PUPIL OUTCOMES 

The analyses show that the IPR/LA does boost pupils* reading scores as 
measured by the CRT-*N but does not change students* attitudes. Higher 
levels of implementation lead to higher reading performance. In addition, 
this effect on achievement is found for all students, regardless of race or 
initial reading level. This latter finding is especially Important because 
it indicates that lower achieving students do profit from the program and 
could in all likelihood profit more if they received a more fully imple- 
mented program. If lower level readers do not get a fuller Implementation of 
the curriculum, then achievement differences between the able and less able 
groups (nay well expand as they progress through elementary school. 
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It is important to note that the <^ffects of the curriculum reported here are 
not large. As indicated above, the cortell itions are modest. However, given 
the overall level of implemeatation and whe conservative analysis technique, 
the fact that an effect uas fowd is iinijortant. One might well expect larger 
gains to emerge with a more fully implemented program. 



Chapter 5 



CONCLUSIONS AND RECOMMENDATIONS. 

The three-year study of the implementation of the IPR/LA in MCPS elementary 
schools has docwwented both program strengths and program weaknesses. On 
the positive side, the study shovs that the program does have an effect or) 
comprehension test perforaacce as measured by the CRT-N. For both higher-- 
and lower-achieving studeata, the curriculum appears to be delivering on its 
promise to provide laore effective instruction for students. 

However, on the aegativ-3 side, the study also shows that, judging from the 
latest data, the prograa is only modestly implemented in the elementary 
schools; implementation £s beyond the beginning level in only about half the 
groups studied. Further, the program remains less well implemented for 
lower-level readers and pupils in the lower grade levels. That is, the 
lower-achieving and lower-srade-level students get less of a "dose" of the 
curriculum than their older, higher achieving peers. Also, since the 
school's years of implementation show little relationship to its implementa- 
tion level, the 1S35 fiiodiags very likely represent the current status. 

Finally, and most significantly, the data show that there is a "snowball 
effect" of implementation on test performance—higher achievers get fuller 
implementation and fuller Implementation leads to better test performance. 
The cumulative effect of this process over the elementary years is to widen 
the gap between lower- and higher-achiaving groups of students. S\{ch a 
phenomenon comes as no surprise when, for example, one reviews the math 
gains of pupils who, over the years, have taken more and higher-level 
courses because of their higher standing in math during the earlier years. 
However, if the link between initial achievement and implementation could be 
turned around (certainly a strenuous challenge for any school system), then 
since higher ifliplementation leads to higher achievement, fjtii^ study's 
findings show that stronger curriculum itii piemen tation for younger and lower- 
<ichieving groups could provide a useful path for reducing group disparities 
-^a school achievement. 

^ased oa these findings tte following recommendations are made: 
RECOMMENDATION 1 

Ways for accelerating the implementation of the IPR/LA are needed. 
Teacher reports dating back several years suggest the need for more 
detailed, hands-on training in specific classroom procedures rather 
than overall orientation to the general IPR/LA curriculum model. 

RECOMMENDATION 2 

Increased efforts need to be made to provide fuller implementation of 
the curriculum for all students. The IPR/LA was not designed as a 
program for able students alone. Ways need to be found for more 
adequately implementing the program with lower-achieving, early-grade 
students. 
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RECOMMENDATION 3 

To echo the final recommendation from the Year I Report, MCPS needs to 
take a more systematic approach to program implementation than tias t[ius 
far been seen, and Co provide the resources to support such a pl2i^. 
There appears to be no formal and consistently implemented long range 
plan for curriculum installation. And after the first stages of 
program initiation and implementation, <^ere heeds to be a more formal 
and explicit pl^n for program support and evaluation, including 
training and materijal resources. The findings of this report, convbined 
with those from earlier studies, indicate that if a curriculum is 
merely delivered to the school house door, i-b either will not take hold 
or will take hold only slowly and unevenly. 
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APPE^raiX A 
DeflnlClon of Types of Discourse 



Types of Discourse 

1. Narration . An account of an event or series of events that form a plot 
and Involve characters In a setting over a period of time. Characteristic 
forms Include short stories, novels, folk tales, fables, myths, legends, 
biographies, autobiographies, diaries, journals, uallads, and story poems. 

2. Exposition . A structured set of ideas and information about a topic, 
often ^Ith generalizations and supporting details. Characteristic forms 
Include reference articles, news articles, feature articles, textbooks, 
and expository tradebooks. 

3. Persuasion . A ,set of statements expressing opinion about a topic or 
product, often vith supporting information intended to convince ot 
persuade the reader/listener. Characteristic forms include advertisement, 
editorials, reviews^ and critiques. 

4. Procedure . A set of directions that indicate the proper sequence of 
steps in making or doing something. Characteristic forms include recipes, 
game directions, signs, and warnings. Also included are <)irections for 
travel, first ald» information forms, science investigations, tests, and 
assignments. 

5. Drama . An event or series of events expressed through the dialogue and 
movement of characters portrayed by actors. Characteristic forms include 
plays, skits, and snosicals. 

6. Lyric. An e:q>cessiffln of an author ' s feelings or perceptions about the 
nature of things* often using figurative language and imagery for effect. 
Characteristic forms Include' lyric poems and songs. 
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APPENDIX B 



IMPLEMENTATION OF SPECIFIC CURRICULAR COMPONENTS 

Implementatioa scores for six major currlcular components are portrayed 
below. Readlog from left to right, the categorlas are laid out In their 
order of Importance to the IPR/LA curriculum model. Implementation findings 
are discussed below for each area, presented in order of Importance. (The 
weighting factor for each component Is Indicated in parentheses.) 



FIGURE B.l 

Average Implementation Level of Each Curriculum Component 
for Third and Sixth Grade in 1985 




G4 3 (N=25B) 
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Comprehension Activities (35%) 



Instructional practices which promote comprehension are most central to the 
IPR/LA curriculum* These Include the following: 

o Developing understanding of the gist of the discourse 
o Developing understanding of the overall structure of the 
discourse 

o U3lng enrichment/ ex tens loo activities 

Implementation status In this area averaged between the "beginning" and 
"partial" levels. Teachers were observed developing an understanding of the 
gist and the overall structure of the discourse with roughly half of the 
groups observed. Enrichment or extension activl ties were observed In 25 
percent of the groups. However, these comprehension actl\^ltles were 
significantly better Implemented aii: the upper grade levels and anong higher- 
achieving students. 

Teachers' estimates that they spent about two- thirds of their total reading 
Instructional time on teaching comprehension skills were confirmed in our 
observations* However, only about half of the teachers reported increasing 
the amount of instructional time they spent on teaching comprehension skills 
as a result of implementing IPR/LA. It appears that teachers were spending 
adequate time on comprehension skills in general but may need to focus on 
specific IPR/LA recommended activities. 

Teaching Strategies (25%) 

IPR/LA emphasizes teaching strategies such as: 
o Encouraging student discussion 

o Encouraging students to predict while reading a selection 

o Using openr'ended questions 

o Webbing and brainstorming 

o Establishing the purpose for reading 

o Relating the reading to student's background knowledge and 
experience 

Teachers have implemented this aspect of the currlculun more completely than 
the other aspects but still only "partially" as defined by the developers' 
standards. While teachers were observed using open-ended questions, 
establishing the purpose for reading, and relating the reading to the 
student's experience in over half of the groups observed, other IPR/LA 
strategies were observed less frequently^ Again, this aspect of the 
curriculum was better Implemented at the upper grades and among higher* 
achieving students. 

Teacher reports confirm only partial implementation; for example, while 45 
percent of the teaching staff placed more emphasis on open-ended quet^tions, 
41 percent emphasized literal questions in teaching reading comprehension. 

Use of Narrative Materials (20%) 

The curriculum encourages the use of the best in children's literature, 
specifically tradebooks for narrative discourse with less emphasis on the 



use of basals end workbooks. The Implementation levels In Figure B.l 
suggest only beginning to partial Implementation of this aspect of the 
curricul^^ 1. The "Narrative Materials" area was significantly better 
icipler. o d at the upper grade levels and among higher achieving students. 
For example> teachers were observed using tradebooks qocq frequently with 
sixth grace groups than with third graders (49 vs. 25 percent). On the 
other hand, sixth grade reading groups were observed using basal readers 
less frequently (25 vs. 54 percent). 

Staff reports also suggested only partial implementation of materials usage. 
While dver 90 percent of the staff were using tradebooks, a similar 
percentage also was still using basal readers. Overall, about two*-thlrds of 
staff reported using workbooks, but more so at the lover grade levels. 
Thus, these- '*old'* and **new'* approaches still overlap la classroom practices. 

Equally revealing as the frequency of usage is the style of using narrative 
materials. For example, the following data suggest that most teachers still 
rely on basal readers, and only augment the ''old** practices with the IPR/LA 
approach. About, one- third of staff reported that they found the "besc** 
macerials from various sources to teach the objectives and fit student 
needs. Twenty percent selected appropriate basal stories and supplemented 
these with other materials. Another one-third used a basal reader jja 
sequence and supplemented it where needed with other materials to teach 
IPR/I4A objectives. Finally, 10 percent of staff used a combination of the 
above approaches depending on the ability level of the students* The&e 
figures aaggest that approximately one-third to one-half of teachers were 
still relying on basals as their primary reading material, despite the fact 
that over 90 percent reported using tradebooks to some extent. Thus, these 
teachers were not Implementing the full concept of the Narrative Materials 
component. 

The usage of basals varied considerably by grade If^vel. The most popular 
approach aw>ng upper grade level teachers was to select the "best" materials 
fri'^rn various sources. In contrast, lower grade level teachers most often 
lined a bosAl reader in sequence and supplemented it vrhere needed with other 
materials. 

Vocabulary IDevelopment (12Z) 

The IPR./1A curriculum suggests that vocabulary words be taught in a 
meaningful context and that teachers encourage students to use the words. 
Tnis aspectt of the curriculum is relatively well implemented, reaching the 
"partial* iiaplementation level an our A-point scale. Teachers were observed 
using at least one of these approaches to vocabulary development in more 
than half l:he reading groups observed. These vocabulary activities were 
better imiplemented at the upper elementary grade levels. 

Grouping Practices (6Z) 

The IPR/LA curriculum encourages teachers to use multiple and varied 
groupln;g pa t terns« This ll; eludes ins true tion in homogeneous and 
heterogemeous groups^ as well as whole*-class and individualized instruction. 
Observed implementation of this aspect of the curriculum was low, not quite 
reaching the "beginning" level, with most teachers observed working with 
reading groups of hoaogeneous reading levels. Virtually all teachers 
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reported grouping students according to reading level for reading 
instruction and also reported using more than one grouping procedure (e.g., 
whole class, individuals, small groups). However, use of more than one 
grouping procedure was generally not observed during reading group 
instruction. 

Decoding Activities (2%) 

The IPR/LA currl'^ulum puts less emphasis on decoding activities in primary 
grades than traciitiooal programs, emphasizing the use of context clues in 
decodic;[j instruction* Observed implementation status was very low on this 
aspect of the curriculum, largely because decoding activities refer to 
skill development found more often below the third grade level. Teachers 
were observed conducting decoding activities with only 19 percent of the 
third grade reading groups and only 10 percent of the sixth grade reading 
groups. 

Teacher reports suggest better implementation in this area. Fifty-nine 
percent of staff reported placing more emphasis on teaching decoding skills 
in context while another 34 percent put an equal emphasis on teaching 
decoding skills in context and in isolation. Still grade differences were 
striking; upper grade level teachers put more emphasis on decoding in 
context than did lower grade level teachers (76% vs. 44%). 

SUMMARY OF IMPLEMENTATION LEVELS FOR SPECIFIC COMPONENTS 

While almost 90 percent of the reading groups we studied were exposed to at 
least the beginning levels of the IPR/LA curriculum, the usage of the 
curriculum is not so advanced as might be expected, given the number of 
years the school have been working with it. Three central features of the 
curriculum were moderately implemented — teaching strategies, materials 
usage, and comprehension activities. Among these, fuller implementation of 
the curriculum could be attained most readily by reinforcing the comprehen- 
sion activities. 



B-4 3 8 



MONTGOMERY COUNTY 
PUBLIC SCHOOLS 

ROCKVILLE, MARYLAND 



Reading Study 
VoliBme 2 
Teclmical Appemdis 
for Final Report 



November 1985 



Wilmer S. Cody 

Superintendent of Schools 



Prepared by the Department of Educational Accountability 



MONTGOMERY COUNTY PUBLIC SCHOOLS 
Rockvllle, Maryland 



READING STUDY 
VOLUME 2 

TECHNICAL APPENDIX FOR FINAL REPORT 



November 1986 



Wllmer S. Cody 
Superintendent of Schools 



MONTGOMERY COUNTY PUBLIC SCHOOLS 
Rockvllle, Maryland 



READING STUDY 
VOLUME 2 

TECHNICAL APPENDIX FOR FINAL REPORT 



by 



John C. Larson 
Suzanne M. Raber 



Steven Frankel, Director 
Departroent of Educational 
Acci?untablllty 



41 



Joy A. Freeh tllng. Director 
Division of Instructional 
Evaluation and Testing 



TABLE OF CONTEOTS 

Page 

Chapter Als Evaluation Methods 

Introduction 1 

Clasarbosn Observation Procedures avA Instrument 1 

Deriving Implementation Scores from Classroom Observations • • • 2 

Pupil ^.ttltude Survey 11 

Chapter A2: Analysis of Curriculum Implementation Differences 

Grade Level and School Differences in Implementation 15 

Implementation Differences by Reading Group Performance Levels . 16 

Teac^r and School Differences in Implementation • • 18 

Implementetion Differences Due to Number of Years During Which 
The Currlculuz^i Was Implemented In the School .19 

Administrative Supports for Curriculum Implementation 20 

Implementation of Specific Curricular Components 24 

Chapter A3: ATialysls of IPR/LA Curriculum Effects on Pupils 

Correlations; Between Implementation, Academic, and 

Reading Attitude Scores 26 

Regression Analysis of Academic Outcomes 27 

Regression Analysis of Reading Attitudes Outcomes 29 

Analysis of Parent Opinions of Pupil Reading Attitudes 

And Activities 30 

. 42 



Chapter Al 



EVALUATION METHODS 



INTRODUCTION 

Volume 2 contains the background data and statistical analysis tables vhich 
support the findings reported in Volume 1 of the Reading S tudy * The 
sequence of the material hsre generally parallels that of the presentation 
in Volume 1, and page references to Volume 1 are cited underneath each topic 
discussed here. A brief explanatory discussion accompanies the statistical 
results. However, the reader is assumed to have familiarity with 
descriptive statistics, correlation coefficients, and analysis of variance 
techniques. 



CLASSROOM OBSERVATION PROCEDURES AND INSTRUMENT 
(Rcf. p. 6) 

Chapter 2, Volume I describes briefly the data collection procedures and the 
items on the classroom observation instrument, A more detailed accounting 
Is presented here* 

Using a direct classroom observation measure modeled after the specifica-- 
tions of the IPR/LA curriculum, reading instruction was observed during 
three time periods (fall, winter, and spring) in the study classrooms. 
Vithin these three broad time periods, actual observation visits were unan«- 
nounced. The observer remained in the classroom for the entire reading 
period, observing all reading groups that the teacher instructed during that 
period or observing whole class instruction* The actual time spent in each 
classroom varied depending on the length of time individual teachers allo- 
cated for reading instruction* 

Observations were limited to students receiving regular reading instruction 
in the classroom; pullout instruction for whatever purpose (remedial, gifted 
and talented, ESOL, etc.) was not observed, and the observation data, there* 
fore, cannot be used to characterize such instruction* 

Over the three--year course of the study, 14 observers were employed to 
conduct the observations for the Reading Study* All had extensive classroom 
experience and either a master's degree in reading or special training and 
experience as a classroom observer* In addition, the observers participated 
in a training session in October of each year to prepare for the observe*- 
tions* 

The observation instruments were intended to describe instruction and mini* 
mlze the extent to which observer Judgtpent was needed* Nevertheless, :^ome 
Judgment was obviously necessary. To assure quality control for the sfeiiy, 
frequent contact was maintained with the observers; and special procedures 
were used to ensure that interrater reliability remained high* In order to 
check interrater reliability, the Reading Study observation supervisor 
joined each observer during each observation time period (fall, winter, 
spring)* These joint observations were conducted in all 20 schools in the 
study* Both the supervisor and the observer coded simultaneously, and then 
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percent agreement was calculated using the supervisor's coding as the 
standard. The reliability averaged 89 percent across all observers In each 
of the three years of data collection* 



The observation Instrument vas designed for either small group or vhole 
class observations and vas used to code teaching behaviors for an entire 
reading period while Instruction was taking place under teacher direction* 
The Inatnment listed different teaching behaviors/ strategies divided Into 
six areas: 

o Compretenslon activities 

o Teaching strategies 

o Narrative materials usage 

o Vocabulary development 

o Grouping practices 

o Decoding activities 

These areas were selected to reflect aspects of Instruction likely to be 
affected by implementation of the new curriculum. The observer coded whetter 
or not each behavior had occurred separately for each of the reading groups 
in the class. After the first year of data collection* the observation 
instrument was modified slightly to eliainate weaker items and Include 
additional instructional strategies and materials. The classroom observa- 
tion items from Year 2 and 3 and their definitions or examples are shown in 
Table Al.l. 

DERIVING IMPLEMENTATION SCORES FROM CLASSROOM OBSERVATIONS 
(Ref. pp. 8-9) 

As sho%m in Table Al.l« the classroom observation Instrument provided many 
items covering the six major currlcular areas. Table Al.2 provides a listing 
by grade level of the average frequencies with which these items were 
observed in the reading groups across the three time points in Year 2 and 
Tear 3. 
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Curricular Claserooa ObfldrvQtloQ I teas 

Catogory Toacber Actlvltlos D«f loltlooa/ExaQples 



COMPREHENSION 
ACTIVITIES 



Dovalop uadorstaadlng of gist 
of dlocourae 

Dovolop uodorataodlfig of otot* 
all atractora of dlocourso 

VltlQS 



Glat 18 tflut Cha story is aootly about, tha 
Qalo Idaa, thoiaa, bast title, concluslooo. 
Tha o^Twall atraatara of oarrstlTa dlscoursa 
Includas charactarlzatloo, plot, and sattlog. 
Soaa mrldaffiaat/axtaadlag activities ara: 
draoatiza atory, aake postar of favorite 
charactar's advaature, ravrite story with 
netf aoding, conatruct aural/oodal. 



TEACBIKG 
STGU^TEGIES 



NARRATIVE 
MATERIALS 
USAGE 



Encourage a tadast diacoaaimi 



Encourage students to predict 
while reading a selaction 
U sa opasr-a&ded qaas tiaaa tti^ 
proaota critical thinking &cs^d 
discussion 

Usa vsuriad atratagias 



Clearly aatabliab porpoao for 
reading 

Ralate text to otudaat** back- 
gEOQod bnotf lodfla &Bd expari- 



Avoid rooad tobia oral readlos 



Eophaaiza tra<tebo(Aa 
Use aacparies&ca atoriaa 



Rely less on baaal raadara and 
tha accoopanying vorkbooka aad 
dittos 



Siaidmt diacaaal<m occurs aoong studants 
and taacber rather than in tescher-directad 
question/answer foraat. 

Pradlctiac^ quaations include: What vill 
happan naxt? What will the unit be about? 
Opao-aadsd qeaatla^ are, for exaapla, "bow* 
and *vhy* quae t ions rathar than literal 
quastioQS. 

Variad atratas^ include webbing, brain- 

atorelng, active listening, paired talking, 

discussion plays, and languaga experience. 

Exaaplas of aatablishlng parposa are: Read 

this salectloo to find out..., listan for 

rbyaing worda in tha passage. 

Bsp»ieesa quaations incla<te: Did you 

evar. How would you feal if it happanad 

to yoo?, Hava you even baan to...? 

Bocod robia oral reading is students reading 

passages aloud in turn. 

Tradateoa&a ara library books. 

E^^aricffica scoriaa era student-authored 

accounts of an individual or group expari- 

anco. 

Baaala ara a sarias of rasdars developed by 
publisbsr^. 



VOCABULARY 
DEVELOPMENT 



GROUPING 
PRACTICES 



DECODING 
ACTIVITIES 



Present and develop selected 
words/concep ts in ps a nin gfol 
Gontazt 

Encourage word laaa 



Usa eailtiplo groapiag pactaraa 



Use context elttea to help 
students decode unfamiliar 
words 

Discourage student use of 
laolatad pboaafiao co sound out 
words 

Avoid isolatad pboaic alesenta 
in helping students decode 
unfamiliar words 



Weanlagfal ces&taxts Include presenting words 
in phraser, sentonces, or passages rather 
than lists. 

Exaaplas of word oaa are: Students use words, 
taacber asks quaations relating to words. 

Groapifig pattama include student Interest 
groups , be terogeneous groups , whole-class 
grouping, hoaogeaeous groups, and individual- 
ized groups. 

Context does are semantic, syntactic clues 
(e.g., pictures, surrounding words/ sen i:en- 
ces) • 

Isolated pfaoneffias are Individual letters. 



Isolated pboaic eleaenta are letter /sound 
relationships (e.g., blends, diphthongs). 
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TABLE A1.2 

Percentage of Reading Groups Engaged In IPR/LA Activities by Grade Level 



PERCENT AGE OBSERVED 



IPR/LA ACTIVITIES 



Grade 2 Grade 3 Grade 5 Grade 6 
(N-S^g) (N-258) (N-208) (N-I62) 



OOMPREHENSION ACTIVITIES 
Gist 

Overall structure 
Enrichment/ extending 

TEACHING STRATEGIES 

Student discussion 
Prediction 
Opeir*ended questions 
Webbing 
Brainstorming 
Establishing purpose 
Relating to experience 
Round robin oral reading 

NARRATIVE MATERIALS USAGE 

Tradebooks 
Experience stories 
Basals 
Workbooks 
Dittos 

VOCABULARY DEVELOPMENT 

Meaningful context 
Word use 

GROUPING PRACTICES 

Student Interest groups 
Whole-class grouping 
Homogeneous groups 
Heterogeneous groups 
Individualized instruction 

DECODING ACTIVITIES 



32 
41 
17 



10 
42 
69 
3 
1 
56 
51 
7 



17 
3 
56 
21 
31 



38 
45 



0 

32 
88 
7 
23 



49 
55 
24 



3 
47 
75 
9 
2 

65 
54 
8 



28 
0 
46 
15 
26 



44 
38 



2 

26 
88 
7 
22 



41 
51 
29 



22 

28- 

73 

5 

7 
47 
45 

6 



53 
2 

31 
8 

38 



35 
49 



1 
34 
80 

3 
21 



56 
63 
26 



14 
45 
81 
3 
5 
71 
56 
6 



50 
1 

20 
8 

31 



48 
48 



5 

32 
77 
9 
28 



Context clues 
Isolated phonemes 
Isolated phonic elements 



16 
17 
25 



5 
2 
9 



4 
1 
3 



4 
1 
1 



Note: N is number of readltig group observations. 
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The listing of the data for the 26 Items In Table A1.2 provides a very 
detailed picture of the curriculum's workings but for this very reason does 
not yield an overall answer to the question of curriculum implementatloiu 
Just as pupils are given a total score across many iteas on, for example, a 
math test, ao also the reading groups need an implementation total score in 
order to study how well» on the average^ the curriculum was implemented 
across grade levels^ across teachers and schools^ and other such analytic 
issues* The observation instrument was **scored** for overall Implementation 
according to the procedures deiscribed below. 

The curriculum authors in the Department of Academic Skills (DAS) specified 
that not all the observation items were equally essential for the curriculum 
to be well implemented. Rathert certain activities were mandatory for 
curriculum Implementationt while other activities were supplementary, and 
still other activities only optional in order for the curriculum to be 
considered well implemented. ThuSf the adequacy of curriculum implementa*- 
tion for each reading group observation can be Judged from the pattern of 
activities specified by DAS. The following series of tables (Tables A1.3 - 
Al.S) identifies the different patterns of observation activities which 
yield different implementation scores for each of the six curriculum areas. 

The implementation score for each area ranges on a scale from 0 (no 
implementation) to 7 (best implemeutation). The o:>servation items contribu-- 
ting to a curriculum a^ea appear across the colu:^;^3 in the tables^ and each 
row specifies the scale value derived from »V,i presence (indicated by 
-yes**), the absence (•'no-), or the optional p?: $nce (-?-) of the various 
observational itess. For example, in Couprehension Activities (Table A1..S), 
if a reading group was observed using all three activities (Gist, Overfill 
Structure, and Enrichment), then It scored a perfect V on Implementation 
in that area« If none of these three activities were observed for a reading 
group, it scored a -Q*" for implementation. Different patterns of these 
three activities yielded different scores on the ""comprehension** scale 
between 0 and 7. 



TABLE A1.3 

Pattern of Comprehension Activity Items Specified for Different Scale Values 



Comprehension Activities 



Scale Score Gist Overall Structure Enrichment 



0 


No 


No 


No 


1 


No 


No 


Yes 


2 


No 


Yes 


No 


3 


No 


Yes 


Yes 


4 


Yes 


No 


No 


5 


Yes 


No 


Yes 


6 


Yes 


Yes 


No 


7 


Yes 


Yes 


Yes 
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Although each curirlculum area wae scored "0** for no Implementation or 
for best Imp 1 emeu t4.i;tlon9 all the scale points In between were not necessar- 
ily defined. Vh^^^c the curriculum authors in DAS did not specify important 
distinctions bet^'een various patterns of items^ the scale does not provide 
different numerical values. Just the O-to-7 range was maintained across all 
curriculum area&o For example, the scale for narrative materials usage 
shown in Table Al.4 bt^low Includes only the scale values 0, 1, 3, 5, and 7« 



TABLE A1.4 

Pattern of Narrative Materials Usage Items 
Specified for Different Scale Values 



Scale Score 




Narrative 


Materials Usa^e 




Tradebooks 


Experience Basals 
Stories 


Workbooks/ 
Dittos 


0 


No 


No 


Ho 


No 


1 


No 


No 




Yes 


3 


No 


. No 


Yes 


? 


5 


No 


Yes 


? 


? 


7 


Tea 


? 


? 


? 



The scale for narrative materials usage was constructed based on the rank 
order of the different types of materials according to their import£^nce in 
the curriculum. IPR/LA emphasizes the use of tradebooks and experience 
stories rather than basal readers, workbooks, or dittos. Consequently, to 
obtain a score of 7, tradebooks must be used during a reading group observa- 
tion (noted by **yes*'), whether or not the other materials were also used 
(noted by **?**}• Reading group observations during which none of these 
narrative materials were used (noted by **ao**} received a score of 0. If 
workbooks or dittos were used in the absence of the other materials, the 
reading group observation received a score of 1. And so forth. 

This same scoring procedure was used for the other five curriculum 
categories as illustrated in the following tables. 
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TABLE A1.5 

Pattern of Teaching Strategy Items Specified for Different Scale Values 



Teaching Strategies 



Scale Student Prediction Openrended Other^ Establish Relate to Round 
Score Discussion Questions Strategies Purpose Experience Robin 



0 


Mo 


No 


No 


No 


No 


No 


No 


X 


No 


Ho 


2 


Yes OR 


Yes OR 


Yes 


OR Yes 


3 


No 


Yes 


0R2 Yes 


? 


? 


? 


? 


5 


No 


Yes 


Yes 


? 


? 


? 


? 


7 


Yes 


? 


? 


? 


? 


? 


? 



Notes: 1. Other strategies included the following: webbing^ brains to rmlngi 
active llstenlngi paired talking^ discussion plays^ and language 
experience. 



2. OR Indicates that one of tao or more activities must be observed 
to receive that scale score. For examplei a reading group 
observation during which the teacher either encouraged students 
to predict what would happen while reading a selection or used 
opep'^ended questions received an implementation scale score of 3. 



TABLE A1.6 

Pattern of Vocabulary Development Items Specified for Different Scale Values 





Vocabulary Development 


Scale Score 


Meaningful context Word Use 


0 
7 


No No 
Yes OR Yes 
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TABLE A1.7 

Pattern of Grouping Practice Items Specified for Different Scale Values 



Grouping Practices 

Student Heterogeneous Vhole^dass Homogeneous Individual 
Scale Interest Groups Grouping Groups Instruction 

Score Groups 



0 No No Tes OR Yes OR Yes 

3 No No Yes Yes Yes 

7 Yes OR Yes ? ? ? 



TABLE A1.8 

Pattern of Decoding Activity Items Specified for Different Scale Values 



Decoding Activities 



Context Isolated Isolated 

Scale Score Clues Pbonesses Phonic Elements 

0 No ? ? 

7 Yes ? 7 



The 0-to«7 scales accomplish one important function — for each of the six 
areas they collapse many items into single scores indicating low- to'-hlgh 
curriculum implementation.: However, these scores cannot be directly com*- 
pared to each other to determine which areas are better Implementedn For 
example, a **3'* in comprehension activities does not necessarily mean the 
same implementation level as a **3'* in teaching strategies. Also, the 
meaning of a is not directly defined in terms of curriculum implements-* 
tion. To overcome these shortcomings, the curriculua authors in DAS were 
once again asked to specify for each of the six scores what scores 
represented **full** curriculum implementation, what scores indicated ''no'* 
curriculum implementation, and which score values reflected '^beginning" or 
••partial- implementation. The O-to-7 scales were thus converted into l-to-4 
scales. Each of the scale points represents the ••same** level of implementa*- 
tion across the six areas; thus, the implementation levels can be compared 
across areas ou the l-to-4 scale. Table A1.9 specifies how the O-to-7 
scales were converted into the l-to-4 scales for the reading groups, and it 
Indicates the percentage of reading group observations (combined across 
Years 2 and 3} which obtained those score values. Note that these percent- 
ages are expressed as cumulative percentages within each area. 
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TABLE A1.9 

Implementation Scoring and Equlpercentlle Cut Scores 
for Reading Group, Teacher, and Student Levels of Data 



Currlcular 
Category 



Final 
A-polnt Scale 



Reading Group 
Level 



7- point Cua^ 
Scale % 



Teacl^r 
Level 



7-polnt 
Scale 



Cum 
X 



Student 
Level 



7-polnt 
Scale 



Cum 
Z 



COMPREHENSION 
ACTIVITIES 



TEACHING 
STRATEGIES 



NARRATIVE 
MATERIALS 
OSAGE 



VOCABULARY 
DEVELOPMENT 



GROUPING 
PRACTICES 



DECODING 
ACTIVITIES 



1 
2 
3 
A 



1 

2 
3 
4 



1 
2 
3 
4 



1 
2 
3 
4 



1 
2 
3 
4 



1 
2 
3 
4 



Not 

Beginning 
Partially 
Fully 



Not 

Beginning 
Partially 
Fully 



Not 

Beginning 
Partially 
Fully 



Not 

Beginning 
Partially 
Fully 



Not 

Beginning 
Partially 
Fully 



Not 

Beginning 
Partially 
Fully 



0 

1 - 3 
4-6 
7 



0 
1 

3.5 
7 



0,1 

3 
5 
7 



3 
7 



32 
58 
90 
100 



15 
23 
89 
100 



26 
66 
67 
100 



46 



100 



61 

93 
100 



92 



100 



0-2.25 
2.26-3.50 
3.51-5.40 
5.41-7 



0-2.20 
2.21-2.60 
2.61-5.00 
5.01-7 



0-2.40 
2.41-4.49 
4.50 
4.51-7 



4.01-7 



1.51-4.00 
4.01-7 



2.01-7 



32 
56 
90 
100 



15 
22 
83 
100 



26 
65 
67 
100 



0-4.00 46 



100 



0-1.50 63 



92 
100 



0-2.00 88 



100 



0-2.50 29 

2,51-4.33 59 

4.34-6.50 88 

6.51-7 100 



r-?.33 

<7 



2 

5.01-7 



3.51-7 



2.34-7 



15 
19 
94 
100 



0-2.33 26 

2.34-4.67 63 

4.6«-5.00 68 

5.0i-7 100 



0-3.50 45 



100 



0-1.50 62 

1.51-4.33 93 
4.34-7 100 



0-2.33 90 



100 



Note: 1. Cum Z Is the cumulative percentage of reading groups, teachers, 

or students who received a given score or lower score. For 
example, 32 percent of the reading groups were scored as not 
Implementing comprehension activities, while 58 percent were 
scored at the beginning level of Implementation or lower. 
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Table Al*9 also specifies the cuQulatlve percentages or cumulative frequency 
distribution of teachers who scored at each point on tte l-to-4 scale. Some 
of th^ analyses were conducted on teacher averages (that is^ the average 
scores of all the teacher's reading groups during the year). But such 
average scores lave a distribution quite different frosn the basic reading 
group distribution* For exaaple^ a number of individual reading groups may 
score a perfect *7'* on implements tion^ but it would be very unusual for all 
of a teacher's groups across the year to have perfect ''T's.** It would be 
fair to label a teacher with consistently high though not perfectly high 
scores as **fully** implemented. Such a teacher might, for exainple, have an 
average of 6*0 on the O-to-7 scale. Conversely, a teacher with a very low, 
but not *'0,** average may be considered as *not implementing** the curricultuiu 
Thus, when examining the teacters' average distribution on the O-to-7 scale, 
the problem is where to draw the lines demarking the foui^point scale. 

The solution adopted for this study is similar to the **norm tables'* produced 
by test publishers. From the basic raw score distributions, a test 
publisher derives standard scores, grade-equivalent scores, or percentile 
scores. Similarly, the basic observation data on the O-to-7 scales are 
converted into l-to-4 standard scores for the reading group distribution, 
the teacher averages distribution, and the pupil averages distribution 
(where pupils carry the average scores from all tte reading groups of which 
they were members over a two-year period.) The a priori Judgments of the 
curriculum authors were used to convert from the 7-point to the A-polnt 
scale, and this conversion produced the percentages of reading groups at 
each of the four scale points. The same percentages (from the reading group 
distribution) were applied to tte teachers' average distribution on the 7- 
point scale to Identify the cut-points for the 4-point scale. Similarly, 
the same percentages were also applied to the pupil score distribution to 
identify the cut-points for the 4-point scale. In this manner the scores 
for the six currlcular areas were all reduced to 4-point scales, each point 
of which had the same meaning across all areas for the reading group's 
distribution, the teacher distribution, and the pupil distribution. 

There was one final step in the scoring process. Just as the subtests on an 
academic achievement test (reading, math, language) are combined into a 
total score, so also were the six scores for curriculum areas combined into 
an overall implementation total score. Again, as the DAS curriculum authors 
specified the items comprising the six scores, they also specified the 
relative importance of tte six scores comprising the total score. The six 
areas are not equally important to the IPR/LA curriculum concept. The more 
Important areas are given more weight in the total score, DAS provided the 
following weights for combining the six 4-polnt scores into a single imple- 
mentation total score* This implementation total score was the dependent 
variable used in the analyses of Chapters 3 and 4 of Volume I. 



Curricular Area 



Weighting Factor 



Cos;prr.;hension activities 
Teatcbing strategies 
Narrsiive materials usage 
Vocabulary development 



35% 
25X 
20% 
12Z 
6Z 
2% 
lOOZ 



Grouping practices 
Decoding activities 



10 
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PUPIL ATTITUDE SURVEY 
(Ref. pp, 8 and 22) 



Student attitudes tovard reading were measured during the fall of each year 
(except In first grade where the Inventory was not considered appropriate) 
with a 16->lteiD Inventory administered by the classroom teacher to all of the 
students In the study. The 16 questions from the inventory are listed below 
In Table ALIO along with the results from the Year 2 and Year 3 surveys. 
Each year these results were summarized for the Reading Study total sample 
and by Individual school and returned to the schooxs for their staff Infor-- 
matlon. 

The 16 questions are related to each other by similar content but reflect 
different aspects of students* attitudes toward reading and activities 
related to reading. To gain a better understanding of the student's reading 
attitudes and to simplify the analyals of stud\int attitudes as they were 
affected by curriculum exposure (ref. p. 22), the 16 Items were subjected to 
a principal components analysis. This procedure clusters similar Items 
together and Identifies several distinct clusters or factors. Four factor 
scores which capture most of the meaning in the questionnaire were derived 
from this procedure. The items comprising each factor are indicated in 
Table Al.ll and are Interpreted as follows; 



FACTOR I - -Likes to read,- The pupil likes to read all kinds of 
books and before going to bed chooses to read over other 
activities and says reading is a favorite subject* 

FACTOR II - -Performer." The pupil likes to act out what is read 
and likes to read aloud , talk about books, and tell 
stories, 

FACTOR III - -Good Reader,- The pupil claims to be a good reader and 
reads difficult books and magazines, 

FACTOR IV - -Writer,- The pupil enjoys writing, answering questions 
about what is read, and making rhymes. 
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TABLE ALIO 

Inventory Items and Response Rates for Student Survey of Reading Attitudes 



PERCENTAGE Y E S 



Grade 2 Grade 3 Grade 5 Grade 6 
IMVENTORY ITEMS N»863 N»1007 N-971 N-898 



Do you like to read before you go to bed? 


80 


82 


78 


79 


Is reading your favorite subject at 
school? 


61 


44 


24 


27 


If you could do anything you wanted to 
doy vould reading be one of the things 
you would choose to do? 


65 


64 


49 


45 


Do you think that you are a good reader 
for your age? 


89 


89 


83 


82 


Do you think that moat things are more 
fun than reading? 


55 


54 


57 


54 


Do you like to read aloud for other 
children at school? 


63 


53 


50 


53 


Do you like to tell stories? 


74 


r 


63 


69 


Do you like to read the newspaper? 


48 


48 


5b 


60 


Do you like to read all kinds of books 
at school? 


78 


68 


49 


47 


Do you like to answer questions about 
things you have read? 


68 


59 


42 


43 


Do you think It Is a waste of time to 
make rhymes with words? 


37 


31 


38 


34 


Do you like to talk about books you have 
read? 


72 


70 


72 


74 


Do you find It hard to write about what 
you have read? 


45 


37 


38 


32 


Would you like to have more books to 
read? 


69 


70 


64 


67 


Do you like to read hard books? 


60 


69 


61 


63 


Do you like to act out stories that you 
have read In books? 


73 


72 


61 


65 
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TABLE Al.n 

rector loodlDga of Studoat Attltudt Snmy Itons Gndo 



r VARIANCE ACCOmED FOSi 



raetort 



UKzs TO mi 

(19-21Z) 



PQRAHBl 

(e-ioz) 



GOODBBADEB 
{Ml) 



Ot) 



Gndoa 
2 3 S 



Grfidofi 
S S 



GmdiQ 
3 S 



3 S 



Id cbop^a Miltg to 
» 

t thlogfi oro eord (un 
ID rcddtoj 

Id like Doro boolcB to 

9£d 

la to read all kinds of 
»oka achool 
)rlte lubjaer la 
lading 

10 to mi Mm {olng 
) ted 



&e to act out otorlaa 

kad lo booka 

la to tall atorldA 

la to rottd aloud for 

that chlldran 
la to talk about 
rifid 



la to md htl booHa 

la to read the dovo* 
per 



I to vrlto about 
lot una road 
a to aoBver queatlooa 
lOUt what vaa read 
e of tlM to Bake 
yiea vlth vorda 



.62 


.61 


.36 


.67 


.69 


-.66 


-.39 


-.57 


.3* 


.60 




.68 




.42 


.54 


.56 


.W 


.36 




.50 




.46 


.6} 


.42 



.33 



.58 



.31 



.36 



.77 


.73 


.76 


.67 


.64 


.61 


.37 


.34 


.64 


.47 


.55 


.49 



.33 



.31 



.30 



.34 



.60 .64 .61 .80 
.71 .61 .37 .(1 
.52 .48 ,3 



•.37 



-.57 



-.45 -.36 



.57 . 32 . 36 
-.36 -.38 



i Only factor loadlni* flriattr than .30 aro ttblad hart. 



-.44 



-.48 



.44 



-.76 -.42 -.76 

.59 -.?8 .62 
-.36 -.64 



The iteas In the four major rows of Table Al.ll cosprlse the four factors. 
A score for each factor was derived by computing the percentage of the Items 
for vhlch the student responded ""yes.** (Where the Item has a negative 
loading, this procedure vas reversed.) The coefficients In the table are 
the it4m loadings on each factor for each of the four grade levels. The 
meaning of a factor Is defined largely by the Items with the highest 
loadings* An Inspection of the Item loadings Indicates that the factor 
analyses for each grade level produced essentially similar results, particu- 
larly /ibove grade 2. Note also that the percentage of variance accounted 
for, ^dhown under each factor name. Indicates the relative Importance of the 
fact^^rs In representing the Information contained In the student attitude 
dat^. The major factor was HLlkes To Read** since It accounted for about 20 
percent of the variance In the student attitude Items. The other three 
factors were significant but played a minor role In expressing the meaning 
of the attitude items. 
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Chapter A2 



ANALYSES OF CURRICULUM IMPLEMENTATION DIFFEREl^CES 

GRADE LEVEL AND SCHOOL DIFFERENCES IN IMPLEMENTATION 
(Ref. Figure 3.3) 

Tha analysis of gtade leval and school difference!^ mfi basad on the average 
Implementation scores for 156 teachers from 17 schools which had all four 
grades in the school and at lecst one teacher per grade level. (A parallel 
analysis based on 857 reading groups revealed similar findings.) The 
dependent variable was the teacher's average on the four-point 
Implementation total score from all reading groups in the class. Analysis 
of Variance resultti are as follows: 



TABLE A2.1 

Analysis of Variance SuEtaary for Grade and School 
Differences on Teacher's Implementation Total Scorr^ 



Source of 
Variation 



GRADE 
SCHOOL 
ERROR 
TOTAL 



Sum of 
Squares 



9.41 
13.07 
45.13 
67.51 



Degrees of 
Freedoa 



3 
16 
136 
155 



Mean 
Square 



3.14 
.81 
.33 



9.45 
2.45 



P < 

.000 
.003 



TABLE A2.2 

Descriptive Data on Cr;rrlculum Implementation 
Scores Across Grade Levels 



Mean 
n 



GRADE 2 



GRADE 3 



GRADE 5 



GRADE 6 



2.05 



42 



2.30 
37 



2.48 
39 



2.69 
38 



TOTAL 



2.37 
156 
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IMPLEMENTATION DIFFERENCES BY READING GROUP PERFORMANCE LEVELS 
(Ref. Figure 3.4) 



Each teacher was given three scores representing the implementiition total 
scores for the beloi^-y otx-, or above«grade reading groups in the classroc^ 
The three scores were the averages for the reading groups vithin-'category 
treasured at the fall, vinterp and spring data points. A single coaprehens£v<& 
analysis could not conducted, since not all teacters teid reading groups 
at all three reading perfors^ance levels* Thus, tHo analyses were conducted; 
one contrasting tha beloif-^versuc*on groups and one contrasting the above* 
ver8U8-*on reading group averages. Each analysis was a Multivariate Analysis 
of Variance (MANOVA) using a within-* teacher factor, UEVELS,'* representing 
the reading group contrast and a be tween-* teachers factor, **GRADE,** repre-- 
sen ting four grade levels (second, third, fifth, and sixth.) Only the 
schools which had all four grade levels were used in the analysis. 

The MANOVA results for the below-versus-on contrast are summarized below* 

TABLE A2.3 

MANOVA F-statistics for Eelov- Versus On-Grade Level 
Reading Group Performance Levels Within Classroom 
(n n 80 teachers) 



BETWEEN- 
TEACHERS 
FACTOR 



GRADE LEVEL 
SAMPLE TOTAL 



WITHIN TEACHER RE/J)I»G LEVEL FACTOR 



Class Average 
Implementa tioti 



Belotf* Versus On-Grade 
Reading Levels 



2.21 
N.A. 



1.18 



8.39' 



F is significant at the .005 level 



The significant F-^statistic for the total sample on tbe below'-versus'-on 
contrast indicates that across all grade levels the belov-*grade reading 
groups tended to get lower Implesaentation scores than tbe on-grade reading 
groups (as seeE in the descriptive data below in Table A2.4.) Since this is 
a within- teacher contrast, the finding eannot be attributed to between- 
teacher differences such as training or materials. 

The nonsignificant F for the GRADE factor on the belo«^on contrast means 
that there were no significant differences between grades In the average 
size of the below-on gap in implementation scores. The ismssignlf leant F for 
the GRADE factor on the class average Implementation scores eieans that when 
below- and on-grade groups are pooled within class, tlieir averages do not 
differ significantly across grade levels. This finding does not necessarily 
conflict with the data above in Table A2.1, since the significant grade 
level differences reported there were based on all readis^ groups within the 
class, not just the subsample identified for the analysis reported here^ 
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TABLE A2.4 

Implementation Total Score for Below-, Od- and Above-Grade 
Reading Groups at Four Grade Levels 



Below- grade Onr grade Above- grade 

GRADE Reading Reading Reading 

LEVEL Level Level Level 



SECOHD GRADE 

Mean - 1.7791 2.2302 2.2293 

S.D. " .6274 .7002 .6029 

N - 35 44 29 

THIRD GRADE 

Mean - 2.2054 2.2758 2.5669 

S.D. - .7512 .7303 .7377 

N " 28 . . 36 26 

FIFTH GRADE 

Mean " 2.2340 2.5482 2.6208 

S.D. - .5785 .6574 .7046 

N " 20 33 24 

SIXTH GRADE 

Mean » 2.4211 2.8555 2.8955 

S.D. - .6232 .5935 .6265 

N - 19 22 11 



The MANOVA results for the on- versus-above contrast are summarized as 
follows: 

TABLE A2.5 

MANOVA F-statistlcs for Co- Versus Above-Grade Level 
Reading Group Performance Levels Within Classroom 
(n « 72 teachers) 



BETWEEN- WITHIN TEACHER READING LEVEL FACTOR 

TEACHERS Class Average Above- Versus On-Grade 

FACTOR Implementation Reading Levels 

GRADE LEVEL 2.05 1.39 

SAMPLE TOTAL N.A. 3,19 

Note: All F-statlstlcs are nonsignificant at the .05 level. 
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Although the above-grade reading group? i to teve hlgter Implementation 

•scores than the on-grade groups (riB ^^c... above In Table k2A)f this 
difference vas not great enough to roaCiS statistical significance* 
Combining the results of the tuo HANOVA analytes^ the broadest generallza* 
tlon appears to be that the belov-grade reading groups tend to receive a 
somewhat lover level of curriculum Implementation than their classmates of 
average or higher levels of reading ability* 



TEACHER AND SCHOOL DIFFERENCES IN IMPLEMENTATION 
(Ref* p. 15) 

Teachers produce a direct effect on the curriculum Implementation levels of 
their reading groups^ and school level Influences on the reading groups* 
Instructional processes are largely transmitted through the teacher and 
various conditions of the teacher's classroom as a whole* This two*stage 
process means that the magnitudes of teacher level and school level effects 
on Implementation cannot be directly compared because a study of teacher 
effects on reading groups already contains within it the school effects* 
The tvo-stage process can^ however^ be studied by an analysis of teacher 
effects on reading groups and school effects on teachers' averages across 
their reading groups* 

A ""nested"* design was used to analyze reading group implementation scores in 
this two-»stage process whereby the TEACHER factor was nested within GRADE 
levels of a school^ and GRADE levels :^re crossed with a SCHOOL factor* The 
analysis required that there be the same number of teachers (2) nested 
within each grade level and the same number of grades levels (A) for each 
school (12 schools had sufficient data for this analysis)* A total of 558 
reading groups across the four grade levels were included in the analysis^ 
The Analysis of Variance results are summarized below in Table A2*6* 

TABLE A2*6 

Analysis of Variance Sums£iary for Reading Group Implementation 
Scores for School^ Grade^ and Teacher Nested Within Grade 



Source of 
Variation 


Sum of 
Squares 


Degrees of 
Freedom 


Hean 
Square 


F 


p < 


SCHOOL 


17.73 


11 


1.25 


2.07 


.041 


GRADE 


13.71 


3 


4.57 


7.59 


.000 


SCH by GRADE 


22.36 


33 


.67 




.349 


TEACHER within 
SCH by GRADE 


28.91 


48 


.60 






VITHIN CELLS 
(Error term) 


148.51 


462 


.32 







ERIC 



The statistically significant F for the TEACHER-within factor means that 
teacher and classroom conditions make a difference in the levels of curricu- 
lum Implementation found across reading groups. This study was not designed 
to measure teacher effectiveness variablesi but the analysis here suggests 
that such a otudy iirould likely uncover a set of meaningful variables. 

The statistically significant F for the SCHOOL factor means that various 
conditions associated with schoo Is make a difference in the average 
implementation levels found in their teachers. Again, this study was not 
intended to examine the variety of school effectiveness factors, but the 
findings here indicate that such a study would likely yield meaningful 
indicators of school conditions affecting instructional processes. 

As with the other analyses above, the significant GRADE level factor 
indicates that teacher implementation averages differ across grade levels 
(see Table A2.2}. Also, a comparison of the F statistics for GRADE and 
SCHOOL indicates that, on the average, the curriculum implementation 
differences found across grade levels within a school are ^:reater than the 
average differences across schoQls. 



IMPLEMENTATION DIFFERENCES DUE TO NUMBER OF YEARS DURING WHICH 
THE CURRICULUM WAS IMPLEMENTED IN THE SCHOOL 
(Ref. Figure 3.5) 

Each reading group was assigned a number to represent how many years the 
curriculum had been implemented in that group's school. To obtain the 
widest range of implementation years for this anal^^sis, the data from Year 2 
and Year 3 were combined across grades 2, 3, 5, and 6. The 178 reading 
groups included in this analysis produced the distribution of Implementation 
years and average implementation scores reported in Table A2.7. 



TABLE A2.7 
Mean Implementation Scores Across Years 
of Curriculum Implementation 




Years of Implementation 
In The School 


Number of 
Reading Groups 


Implii^eigii t& tlon 
Mean 


1 Year 


12 


2.37 


2 Years 


37 


2.20 


3 Years 


51 


2.49 


4 or More Years 


78 


2.46 



A two- factor Analysis of Variance was conducted using the YEARS and GRADE 
factors. The GRADE factor was included since earlier analyses Indicated 
significant grade level differences. The ANOVA results are summarized in 
Table A2.8. An earlier analysis Indicated no significant interaction bet- 
ween YEARS and GRADE; thus the Interaction term was dropped from this analy- 
sis. 
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TABLE A2.8 

Analysis of Variance Sumaary for Grade and Years of 
Implementation on Reading Group Ir! piemen tat Ion Score 



Source of 
Variation 


Sua of 


Degrees of 

K JL C wUWUl 


Mean 


If 


P i 


VITAD C 


1 •17 




one 

.395 


0.97 


• 41 


GRADE 


6.24 


3 


2.080 


5.11 


• 002 


ERROR 


69.63. 


171 


.407 






TOTAL 


78.03 


177 









The lack of a significant F for the YEARS factor indicates that levels of 
curriculum were essentially similar regardless of tov long the curriculum 
had been implemented in the school. The GRADE factor indicated significant 
grade level differences as reported above in Table A2.2« 

ADMINISTRATIVE SUPPORTS FOR CURRICULUM IMPLEMENTATION 
(Ref. pp. 17-19) 

The data on the adequacy of administrative supports for curriculum implemen- 
tation are summarized in Chapter 3. Table A2.9 details the Year 2 and 3 
staff responses to questionnaire and interviev items about administrative 
supports for the curriculum. The table lists the questionnaire and inter* 
view items relating to in-service training, other types of staff assistance, 
curriculum materials availability and concerns, and monitoring curriculum 
Implementation. The type and number of staff responding (RESPONDENTS, N) 
and the percentage of respondents who answered yes (% YES) are given for 
each item. The type of staff responding to each item and the data 
collection method (questionnaire or Interview) are abbreviated as follows: 

TQ - Classroom Teacher (Questionnaire) 
MQ - Media Specialist (Questionnaire) 

RQ - School- based Special Education Resource Room Teacher (Questionnaire) 

SQ - Special Education Teacher (Questionnaire) 

TI - Classroom Teacher (Interview) 

RI - School- based Reading Teacher (Interview) 

PI - Principal (Interview) 

Note that the number of respondents for each item varies because some Items 
were asked only of certain staff types or were included only in the inter- 
views. 
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TABLE kl.S 

Staff Responses to Questionnaire and Interview Items 
Abou^t Administrative Supports for Curriculum 



QUESTIONS RESPONDENTS N % YES 



Icservice Training 

Have you received any in-service TQ,MQ,RQ,SQ 647 86 

training on IPR/LA this year? TI,RI 

Was the content helpful to you in TQ,MQ,RQ,SQ 545 9i 

implementing the new curriculum? TI,RI 

Is the in-service training sufficient TQ,MQpRQ,SQ 602 64 

for implementation of IPR/LA? TI,RI,PI 

Did the in-service training include? 

Program overview TI,RI 108 70 

Objectives (narration, exposition) TI,RI 184 90 

Selection of instructional materials/ TI,RI 108 43 

core books, basal a 

Use of instructional strategies TI,RI 184 65 

Interpretation/use of CRT results TI,RI 184 45 

Organization of instructional guide TI,RI 108 58 

Use of illustrated units (i«e« lesson TI,RI 108 46 

plan, miniunit, etc*} 

Other Types of Assistance Needed by Teaching Staff 

What additional assistance do you need 
in implementing IPR/LA? 

In-service workshops TQ,SQ,TI 542 47 

Materials for teacher use TQ,SQ,TI,RI 563 73 

Opportunities to visit IPR/LA TQ,SQ,TI 539 55 

classrooms 

Individual sessions with specialists TQ^SQyTI 539 44 

Time to read materials, etc* TQ,SQ,TI,RI 563 83 
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TABLE A2.9 (cont.) 



QUESTIONS RESPONDENTS N Z YES 



Vhac additional assistance do you need 
In laplementlng IPR/LA? (continued) 



Demonatratlon lessons 


TQ,SQ,TI 


540 


67 


MCPS In-servlce courses 


TQ,SQ,TI 


538 


35 


Curriculum Materials: Availability and C 


ther Concerns 






Are the following materials available? 








Instructional Guides 


TQ,MQ,RQ,SQ 


624 


99 




TI 






Core Book Lists 


TQ,MQ,RQ,TI 


568 


95 


Basal Correlation Sheets 


TQ,MQ,RQ,SQ 


500 


80 




TI 






CRTs In narration 


TQ.RQ.SQ.TI 


477 


92 


Novel tests (grades 4-6 only) 


TQ,RQ,SQ,TI 


247 


89 


Scope and Sequence Charts 


MQ.RQ.SQ.TI 


278 


96 


Overview Manual 


TI 


174 


93 


Are the following materials helpful? 








Instructional Guides 


TQ,MQ,RQ,SQ 


571 


97 




TI 






Core Book Lists 


TQ,MQ,RQ,TI 


478 


98 


Basal Correlation Sheets 


Vn,MQ,RQ,SQ 


311 


97 




TI 






CRTs in narration 


TQ,RQ,SQ,TI 


350 


88 


Novel tests (grades 4<-6 only) 


TQ,RQ,SQ,TI 


183 


98 


Scope and Sequence Charts 


MQ.RQ.SQ.TI 


221 


98 


Overview Manual 


TI 


144 


97 


Have you experienced any problems with 








the following materials? 








Instructional Guides 


RI.PI 


37 


51 


Core Book Lists 


RI.PI 


496 


70 


Basal Correlation Sheets 


RI,PI 


32 


22 
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TABLE A2.9 (cont.) 



QUESTIONS 


RESPONDENTS 


N 


X YES 


Have you experienced any problems with 
the folloving materials? (continued) 








CRTs In Narration 


TI,RI,PI 


372 


48 


Novel Testa (grades 4'*6 only) 


RI 


17 


18 


Scope and Sequence Charts 


RI 


21 


19 


Overview Manual 


RI 


15 


7 


Monitoring Curriculum Implementation 








Have you developed any guidelines for use 
In monitoring Implementation? 


PI 


16 


63 


Who Is responsible for mo^jtorlag 
Implementation of the IPR/LA? 








No one 


TI 


177 


2 


Principal 


TI 


177 


61 


School Reading Teacher 


TI,RI 


216 


82 


Media Specialist 


TI 


177 


10 


Area Reading Specialist 


TI 


97 


28 


What difficulties do you face In 
monitoring Implementation? 


• 






Lack of time 


RI,PI 


18 


56 


Teacher resistance 


RI,PI 


18 


39 


Lack of guidelines 


PI 


9 


11 


Lack of area supports 


PI 


9 


22 



66 

23 



IMPLEMENTATION OF SPECIFIC CURRICDLAR COMPONENTS 



Appendix B summarize 6; the data on implementation levels of six major currl-* 
cular components. Table A2.10 glv s the Year 2 and 3 staff responses to 
questionnaire and interview items on instructional practices relating to 
five components of the IPR/LA curriculum. Tt» table Includes the question- 
naire and interview items relating to comprehension activities^ teaching 
strategicoi narrative materials usage» grouping practicesi and decoding 
activities. As in Table A2.9> the type and number of staff responding (RES- 
PONDENTS ^ N) and the percentage of respondents who answered yes (% YES) are 
shown for each item. The aimei abbreviations have been used to indicate the 
type of staff responding to each item and the data collection method. Again^ 
the numl .t of respondents for each item varies because some items only were 
asked of certain staff types or only were included in the interviews. 

TABLE A2.10 

Staff Responses to Selected Questionnaire and Interview Items 
About Instructional Practices 



QUESTIONS 



RESPONDENTS 



N 



% YES 



Comprehension Activities 



What percentage of ; 
instructional tic ^ 
teaching compreheu^ 



total reading 
. you spend on 
fskills? 



Has the amount of instructional time you 
spend on comprehension skills increased 
as a result of implementing IPR/LA? 



TI 



TQ,TI 



147 



538 



70l 



55 



TQ,RQ,SQ,TI 



575 



Tea ^ ' Strategies 

Hou -nfich emphasis do you place on asking 
litetc.l vs. open-ended questiccxB in 
teaching reading comprehension? 

About equal emphasis 12 

More emphasis on literal questions 41 

More emphasis on open-ended questions 45 

Emphasis varies depending on ability level 1 

Note? T. This is the average percentage of instructional time that 
teachers reported spending on teaching comprehension skills. 




TABLE A2.10 (cont*) 



QUESTIONS 

7ec of Narrative Materials 

Are the following materials In uoe In 
your clasa for reading Instruction? 

Tradebooks (Co re books) 

Basal readers 

Workbooks 



Grouping Practices 

Do you group students according to 
reading achievement level for 
reading Instruction? 



ilom emptmsis oa ^r^aching dec.oding 

skills in eoRtext 
Kore eoBplmsis on teaching decoding 

skills in isolation 
About equal e^Qphasis 

Eisphasls varies depending on ability 
level of group 



RESPONDENTS N Z YES 



TQ,RQ,SQ,TI 


580 


94 


TQ,RQ,SQ,TI 


584 


92 


TQ,RQ,SQ,TI 


581 


66 


TQ,RQ,TI,RI 


589 





35 
19 
36 
]0 

TQ,TI 539 97 

TQ,TI 523 96 



TQ,RQ,SQ,TI 562 

59 
7 

34 
1 



Which of the following approaches best 
characterizes the way you plan to teach 
the objectives specified for reading? 

Use a basal reader in sequence and 
supplement with other materials 

Select basal stories and supplement with 
other materials 

Select IPR/LA objectives and find best 
materials from various sources 

Combination based on level 



Do you use more than one grouping 
procedure (whole class, individuals, 
small groups) for reading instruction? 

Decoding Activities 

How SQiiich emphasis do you place on teaching 
d(dCoding skills te context vs* teaching 
skills in isolation? 
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Chapter A3 



ANALYSIS OF IPR/LA CURRICULUM EFFECTS ON PUPILS 

CORRELATIONS BETWEEN IMPLEMEirr ATION , ACADEMIC, 
AND READING ATTITUDE SCORES 
(Ref. p. 20) 

The pupil measures as described in Chapter 2, Volume I Include the 
following^ 



o Curriculum level 



o Reading pretest 



o Reading postteat 



o Attitudes toward Re&dlng 



Mean of all reading groups of which 
pupil was a member during two years. 

California Achievement Tests , read- 
ing subtest (CAT) from fall grade 2 
or fall grade 5. 

Criterion-Referenced Test for Read- 
ing Narrative (CRT-N) from spring 
grade 3 or spring grade 6. 

Factor scores from pupil question-* 
naire in grades 2, 3, 5 and 6: 
LIKES TO READ ~ Pupil enjoys reading 

and related activities; 
PERFORMER Pupil likes to discuss, 

act oriit stories, read aloud; 
GOOD READEX — Pupil claims to be 

good re^ier, reads difficult books; 
T^'iiIT3l — Pupil enjoys writing, mak- 
ing rhymes « 

In tercor relations of these measures; are included h^l/:^^ in Table A3.1. The 
pupil attitude scores in Table A3.1 are the means Che Year 2 and Year 3 
scores for pupils. The '^curriculuai'' ^cor3 is the ave^'Sge implementation 
levels pupils recelired d%£?;:ifig Year 2 and Yeiir 3* Intercorrelations for the 
grade 2-3 cohort appear below the diagonal and for the grade 5-6 cohort 
above the diagonal in Table A3.1« 

The correlations show that curriculum implementation level is linked to the 
pupil reading posttest, particularly in the upper cohort. Yet, 
Implementation level is also associated with the pretest score, s\\iggesting 
that higher level readers tand to receive a higher level of curriculum 
implementation. The regre^sioti analysis reported be low identifies more 
specifically the effects of tbe curriculum on reading gains. 

The at.titude scores show no slgt^lf leant relationship with curriculum ieple- 
mentation level, as will be discussed more fully below. There is, however, 
a tendency for pupils with higher reading scores to have more favorable 
attitudes toward reading and to see themselves (accurately) as better 
readers. 
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TABLE A3.1 

Intercorrelatlons of Pupil Measures » Lower Grade Cohort Below Diagonal 
(n">458) and Upper Cohort Above Diagonal (&"553}» decimals omitted 









1. 


n 
2. 


£ A S U R 
3. 


E S 
4. 


5. 


6. 


7. 




1. 


Curriculum 


- 


31 


36 


03 


02 


04 


-06 


M 


2. 


Rending Pretest 


17 


- 


73 


28 


02 


30 


-03 


E 




















A 

S 


3. 


R<s:adlng Posttest 


17 


6A 


- 


27 


04 


22 


01 


u 


A. 


Likes to Re^d 


-06 


05 


06 




27 


33 


20 


R 




















E 


5. 


Performer 


-05 


00 


06 


44 




28 


40 


S 


6. 


Good Reader 


07 


26 


13 


18 


18 




23 




7. 


Writer 


-02 


06 


12 


33 


39 


16 





REGRESSION ANALYSIS OF ACADEMIC OUTCOMES 
(Refe pp, 20-21) 

The correlations In Table A3.1 Indicate that the levels of curriculum 
Implementation are significantly associated nlth pupil posttest scores, .17 
In the lower cohort and ,36 in the upper cohort. But a large portion of 
this elation is due to the correlation of both implemeixti tlon and 
posf cH with the pretest. In order to estimate the effect of the Impleaen- 
tatioc^ on pupil reading gjains, a regression model was developed using read- 
ing )j)08tte8t as thQ dependent variable and pretest and curriculum as the 
independent variables. Tli^ 99cdel ml^e^ Included the implementa tlon-by- 
prrttest interaction tera t-^^ t^iujt the equivalence of curriculum effects 
across the range of pretest reading a?;>llltie8. Also, a variable 
represeBting the majority-minority grouj;) contrast was Includedo This 
r^gre^i^ion model was analyzed for both then lower upper cohorts with the 
Z'esT&lZB sussmarized in Tables A3. 2 and A3e:> 

TABLE A3. 2 

Rfiigression Analysis Summary of Implenentation, Pretest, Pretest-by-» 
Implementation and Minor! ty/Najority Group on Reading Gains 
(Two-year effect, grades 2 to 3; n » 555) 



Independent 
Variable 


Senlpartlal 
Correlation with 
Reradlng Posttest 


t-statlstic 


P 


Pretest 


ol92 


5.87 


.000 


lapleiaen ta tlon 


.079 


2.41 


.016 


Pretest X Implt. 


-.064 


-1.98 


.0A8 


Maj/nln Race 


.052 


1.60 


NS 
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TABLE A3. 3 

Regression Analysis Summary of Implementatlony Pretest^ Pretest-b]^' 
Implementation and Minority /Majority Group on Reading Gains 
(Two-year effect, grades 5 to 6; n » 459) 



Independen t 
Variable 


Sealpartlal 
Correlation with 
Risj^ding Posttest 


t-statistic 


P 


Pretest 


.205 


6.54 


.000 


Implementation 


.113 


3.62 


.016 


Pretest X Implt. 


-.075 


-2.41 


.016 


Maj/oln Race 


.007 


0.22 


NS 



The semipartial correlations indicate the strength of association between 
the dependent variable and each independ^ioit variable apart from their mutual 
correlations with each other and the dependent variable* Thus, the correla-- 
tions of implementation with reading posttest adjusted in these equations 
for pretest are interpreted as thA^j implementation-reading gains 
correlations. Both lower and upper cohoF;&8 indicated significant links 
between implementation and reading gains. 

The majority/minority differences on reading gains were nonsignificant for 
both the lower and upper cohorts. 

The pretest-by-implementation interaction ter@s were statistically signifi- 
cant in both the analyses. Thus, a more detailed analysis was conducted to 
examine how different the implementation effects on reading gains were for 
various levels of pretest score. 

For both the lower and upper cohorts, the range cf implementation scores ims 
divided into low, medium, and high categories, and the pretest CAT scores 
were similarly categorized. Pupil gains, calculated from the residuals of 
the regression models described above» were examined In the three- by- three 
table of implementatiott-by-CAT categories, and the cell means i^^^r: displayed 
below in Table A3.4. 

TABLE A3. A 

Reading Gains for Different Levels of Curriculum 
Implementation and Reading Pretest 



PRETEST 
LEVEL 






IMPLEMENTATION LEVEL 


Low 




Medium 


High 


Low Gd 


2-3: 






.29 


1.39 


Gd 


5-6: 


-2.07 




-.89 


.24 


Medium Gd 


2-3: 


-.19 




-.30 


-.05 


Gd 


5-6: 


-1.41 




.42 


2.52 


High Gd 


2-3: 


.19 




.42 


-.32 


Gd 


5-^: 


-,18 




.16 


-.38 
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The psittarQ of reading gains is inconsistent across levels of Implvroc^i^i ration 
and prebioto For exaaple^ in both cohorts pupils with low or medlv^i^/ level 
reading abilities at the pretest appear to have higher reading gains asso** 
elated with higher levels of Implementation^ but this pattern is reversed 
the high-pretest group vh^re the high- implementation group has the lowest 
reading gains. Or, for the lower cohort, the highest average reading ^Tains 
appear in the low-pretest group (mean « .58); but in the upper cohort, this 
group has the lowest average reading gain of the three pretest levels (whei:>» 
the mean is <-1.29). The presence of such inconsiiTtencles precludes useful 
generalizations about the pre test-'by- implementation interaction* 

REGRESSION ANALYSIS OF READING ATTIUDES OUTCOMES 
(Ref. p. 21) 

Pupil attitudes toward reading, as measured in the fall of Year 2 and Year 
3 were used for these analyses of ths effecta of Year 2 Implementation on 
the fall Year 3 attitude scores* In each of four regression equajtions, the 
Year 3 attitude score was regressed on the Year 2 attitude acbre, the Year 2 
reading pretest, and the pupil Year 2 implementation score* The semipartial 
correlations listed below in Tables A3.5 and A3.6 indicate the strength of 
association between the dependent variables and tte predictor variables 
independent of their mutual relationships with each other* Since this 
procedure statistically adjusts the outcome attitude score for the attitude 
pretest score, th6 remaining semipartial correlations represent the links 
between predictor variables and attitude change* 

TABLE A3. 5 

Semipartial Correlations and t- statistics for Reading Pretest, 
Attitude Pretest, and Pupil Implementation Score wl;;.h Four 
Reading Attitude Scores (Lower Cohort, qb599} 



INDEPENDENT ^ DEPENDENT VARIABLES 



VARIABLES 


Like 
r 


to Read 
t 


Performer 

r t 


Good 
r 


Reader 
t 


Writer 

T t 


Reading 
Pretest 


.069 


HS 


.010 


NS 


.181 


4.62 


-.027 


NS 


Attitude 
Pretest 


.361 


9.49 


.317 


8.14 


.168 


4.29 


.191 


4,75 


Implemen- 
tation 


-.015 


NS 


-.005 


MS 


.029 


MS 


-.013 


NS 


r2 


.137 


31.44 


.101 


22.16 


.086 


18.79 


.037 


7.53 



A review of the semipartial correlations in Tables A3.5 and A3.6 indicates 
that on seven of the eight reading attitude scores analyzed for the lower 
and upper cohorts, the curriculum implementation score was not significantly^ 
related to reading attitude change. In the upper cohort, there was a 
tendency for higher implementation scores to be associated with lowered 
Liking-To-Read scores. However, the generally nonsignificant correlations 
suggest no consistent links between the curriculum and readln^^ attitudes. 
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It l8 U8uall7 difficult to am^aa pupil attitudes^ especially with younger 
chlldreiu Note the low corridlatlons are even smaller for tha lover cohort* 
Al80| due to the study's tasting schedule, only one year of curriculum 
effect could be analyzed, that Is, ths Year 2 l^plesaantatlon on tte Year 2-3 
attitude change. Although txo years of Implei^entation data were available, 
tba final pupil attitude score was collected Ib the fall of Year 3« A otudy 
of ttfo or TOre years* cumuliatJLve exposure to the curriculum may potentially 
reveal effects on reading fittltude change, particularly with older pupils. 



TABLE A3. 6 

Si^ipartial Correlatic^ns and t-statistics for Reading Pretest, 
Attitude Pretest, and Pupil I'^plementatloa Score with Four 
Reading Attitude Scores (Upper Cohort, n«S24} 



INDEPENDENT DEPEHD EKT VARIABLES 

VARIABLES Like to Rsad Performer Good Reader Writer 

r t r t r t ; r t 

Reading .224 6.07 ToSl NS 7206 TI^ 7029 NS^ 
Pre test 

Attitude .425 11.48 . 480 12.55 . 354 9.28 .281 6.68 
Pretest 

Implement- -.110 -3.10 -.072 NS -.010 NS -'aOSS NS 
tation 

.232 71.62 .238 54.25 .243 55.62 .08^ 15.88 



ANALYSIS OF PARENT OPINIONS ON PUPIL 
READING ATTITUDES AND ACTIVITIES 

Parent opinions about children* reading attitudes and activities were 

assessed by a telephone survey at the ^.nd of each year on a subsample of 
parents numbering about 300 per year for mch cohort. The 21 questions from 
the survey are lis.ted belov in Table A3.7 along with the results from the 
Year 2 and Year 3 surveys. Each year these results were summarized and 
returned to the sctools for their staff Information. 

Since the results of the parent opinion survey were derived from such a 
small sample and, as the reader will find below, were redundant in substance 
with the results from the pupil attitude questionnaires, these results were 
not summarized in the main body of the Volume I report. 
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TABLE A3. 7 

Survey Items and Responses for Parent Survey of Student Readlcg Attitudes 



QUESTION 


RESPONSE(S) 


GRADE 2 
N-309 


GRADE 3 
N-311 


GRADE 5 
N-318 


GRADE 6 
N-284 


Is your child able to read? 


X Ye5« 


98Z 


99% 


100% 


100% 


At what age did your child 
first begin to read? 


Mean age« 


5.5 


5.5 


5.6 


5.6 


Was vour child nrlffiArllv 
taught to read In the 
Montgomery County Public 
Schools? 


X Yes« 


762 


71% 


72% 


68% 


What Is your child's 
reading level In 
school? 


% Below grade" 
X On grades 


10% 
49Z 


10% 
49% 


9% 
45% 


13% 
39% 




X Above grade" 


42Z 


41% 


47% 


48% 


Did you and/or other family 
menibers read to vour child 
before he/she started 
school? 


X Yes« 


94Z 


94% 


94% 


93% 


Does your child participate 
In any "special** reading 
program In addition to the 
reisular dafifiroom iTifltme tlon? 

iiCafc WAOOO^ Will A-iMO W& W^wU • 












Is your child receiving pri- 
vate tutoring In reading? 


% Yes*^ 


5Z 




12 


5% 


Does your child enjoy 
reading/ looking at books 
outside of school? 


% Yes- 


93S 


95% 


90% 


86% 


IF YES, does your child 
usually finish reading/ looking 
at the books ne/sne reads/ 
looks at? 


% Yes» 


90Z 


94% 


93% 


95% 


Does your child discuss with 
you and/or other family 
members the books he/she 
reads/ looks at? 


Z Yea- 


87% 


87% 


83% 


83% 
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TABLE A3. 7 (cent.) 



GRADE 2 GRADE 3 GRADE 5 GRADE 6 

QDESTION ^ RESPONSE (S) W"309 N°311 N°318 ««'28A 

Does your child read/look at 
any section of the dally 



newspaper? 


X Ye8« 


55% 


69% 


71Z 


75Z 


Does your child read/ look 
at magazines? 






83% 


91Z 


87Z 


Does your child e^r^ixess iiti 
Interest In going m the 
public library? 




80% 


84% 


78Z 


79Z 


IF TES» approximately how 
many times per month does 
he/nhe go to the public 
library? 


Mean number 
of tlmesn 


1.9 


2.0 


2.2 


2.6 


Does yoar child enjoy 
reading to others? 


Z Yes« 


80% 


77% 


56Z 


58Z 


Does your child enjoy 
being read to by you or 
someone else? 


% Yes« 


91% 


87% 


69Z 


74Z 


Does your child read^ or 
attempt to ready printed 
materials on billboards » 
cereal boxes^ etc.? 


Z Yes- 


98% 


98% 


98Z 


98% 


Does your child like to 
read/iooic at iiction books? 


% Yes« 


91% 


94Z 


93Z 


92% 


Does your child like to 
read/look at nonflctlon 
books? 


X Ye 8^ 


69% 


77Z 


74Z 


73% 


Do .you think your child 
has confidence In his/her 
rblllly to read? 


Z Yes» 


90% 


90Z 


95Z 


92% 


How vould you rate your 
child's attitude toward 
his/her reading 
Instruction In school? 


Z Very favorable^ 57Z 
Z Somewlmt favorable** 38% 
Z Somewhat isnfavorable^SZ 
% Very unfavorable- 2% 


50Z 
UX 
6X 
OZ 


4AZ 
48Z 
6Z 
2Z 


43% 
49% 
6% 
1% 
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fkny of the 21 iteos ar© related to each other by almllar con ten t^ but at 
thc^ same time the Itesna differ regarding the typea of oaterial or ths 
contexts of the child's reading habits. To gain a broader understanding of 
child reading interests and to simplify the aualyois of the parent opinions, 
the 21 items were subjected to a principle components analysis. This 
procedure groups sienilar items together, like grapes in a cluster, and 
identifies several different clusters or factors;, 

Four factor scores which capture most of the meaning in the questionnaire 
were derived from this procedure* The items comprising each factor are 
indicated in Table AS.S, along with their factor loadings (as explained for 
Table Al.ll), and are interpreted as follows: 

FACTOR I - -Likes to Read.'' The child enjoys and l»s confidence in 
reading, goet; to the library, and finishes books. 

FACTOR II - ''Serious Reader." The child likes to read magazines, 
newspapers and nonflctlo^ b^^oks. 

FACTOR III - -Social Reader. The child likes to be read to, to read 
to others and to discuss what is read. 

FACTOR IV - -Other Reading.- The child Hkes to read fiction books 
and other materials. 

As with the pupil attitudes and academic scores, the currlculi^m' s effect In 
changing the parent opinion scores can be examined if^ the scores can be 
statistically adjusted for their status before a curriculum treatment. Since 
the same parents were not necessarily called each year, the subset of 
pax*ents for whom scores are available before and after a school year is 
relatively small, numbering less than 100 in each of the lower and upper 
grade cohorts. 

In spite of the small numbers, an analysis was conducted on these subsamples 
In the same manner as the pupil attitude scores in order to determine if 
there was at least suggestive evidence linking curriculum Implementation 
levels with parent opinion change. For the analytic subsamples in the lower 
and upper cohorts, parent opinion scores were available from the Spring of 
Year 2 and Year 3. Thus, the effect of the intervening Year 3 implementa- 
tion levels was examined. As with the pupil attitudes analysis, regression 
equations were analyzed with each of the four Year 3 parent opinion scores 
as dependent variables, and the Independent variable set was composed of 
(1) the respective Year 2 opinion score, (2) the pupil's CAT reading score 
measured at the beginning of Year 3, and (3) the pupil curriculum implemen- 
tation score indicating the level of the curriculum to which the pupil was 
exposed during Year 3. 

The results are summarized in Tables A3. 9 and A3. 10. Once again, the semi- 
partial correlations indicate! the direct link between the dependent variable 
and the respective indepjencSent variables apart from any relationships shared 
among the other variables in the equation. This provides one way of analy- 
zing the correlates of -change scores- or the difference between the Year 2 
and Year 3 opinion score. The correlation between a Year 3 attitude score, 
thus adjusted for the Year 2 score, and the implementation score is inter- 
preted as the curriculum's effect on opinion change. 
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TABU A3,8 

Factor LoadlBgfl of Pmut Attitude Sumy Iteaa by Grade 



CE ACOOUKTED mi 



»nfldonco In 
} read 

» roodln^ and 
!»ooko 

iff fflvorsblo 
toirord roodln^ 

m 

mA latorost 
^0 llbrr^ty 



Bago8ln«6 



to rtad 

I books 

P«rt of tho 
papor 

800 books 



rs 

rs^dii&s to 



to road 
»ka 

^thar printad 



Paetore 



LIKES TO READ 
(U-19Z) 



Gradas 
3 5 



.39 ,69 .69 ,61 



.59 .49 .77 .62 



.58 .55 



.59 



.51 .39 .69 



.57 



.31 

.32 *.42 
.66 



.52 



sums mm 

(9-llX) 



Grsdao 

3 5 6 



SOCIAL READEH 
(1M7X) 



Gradas 
2 3 5 6 



.57 .63 .58 



.72 



.71 M 



.55 .74 



.69 



-.60 



.32 



.62 



.58 



.73 



actor loadtngi graatar than .30 ara tablad hora. 



.40 



.66 



.63 .53 .76 .55 



.^1 M .51 .49 



.33 .66 .62 



.67 



OTHER HEADircC 
(9-lOX) 



Gradaa 

3 5 



.31 .45 



.45 



-.62 



.31 



.32 

-.33 -.41 



.60 



.37 



M .66 



.75 



.76 .65 
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TABLE A3. 9 

Semlpartlal Correlations and t-statlstlcs for Reading Pre tea t. 
Attitude Pre testy and Pupil Implementation Score with Four 
Parent Opinion Scores (Lower Cohort, n«96} 



INDEPENDENT 



DEPENDENT VARIABLES 



VARIABLES 


Likes 


to Read 


Serious 


Social 


Other 






r 


t 


r 


t 


r 


t 


r 


t 


Reading 
Pretest 


.142 


NS 


.148 


NS 


-.086 


NS 


-.012 


NS 


Attitude 
Pretest 


o401 


4.55 


.141 


NS 


.228 


2.27 


-.070 


NS 


Implement 
tatlon 


-.012 


NS 


-.096 


NS 


-.067 


NS 


-.033 


NS 


r2 


.270 


11.33 


.061 


NS 


.066 


NS 


.007 


NS 



Note: t-statlstlcs listed are significant at the .05 level or beyond. 



TABLE A3. 10 

Seiiilpartlal Correlations and c- statistics for Reading Pretest, 
Attitude Pretest, and Pupil Implementation Score with Four 
Parent Opinion Scores (Upper Cohort, n>70) 



INDEPENDENT 
VARIABLES 



DEPENDENT VARIABLES 



Likes to Read 
r t 



Serious 
r t 



Social 
r t 



Other 
r t 



Reading 
Pretest 

Attitude 
Pretest 

Implemen- 
tation 



.234 2.07 
.310 2.75 



-.167 
.224 



NS 
5.86 



.277 
-.026 
-.128 

.086 



2.44 



NS 



NS 



NS 



.011 
.174 
•.014 
.031 



NS 



NS 



NS 



NS 



.022 
.344 
-.192 
.172 



cJS 



3.18 



NS 



4.92 



Note: t'Statlstlcs listed are significant at the .05 level or beyond. 

The correlations of Implementation with parent opinion change are 
nonsignificant on all four scores for both cohorts. Thus, there Is no 
evidence of curriculum effects on parent perceptions of their children. 
Once again, the sample for this aealyels constituted only about 7 percent of 
all the pupils In the cocjirts, and a fuller sampli^ may reveal more signifi- 
cant findings. Also, the analysis was conducted en just the third year of 
implementation data, not on a two-year cumulative effect of curriculum 
exposure as was studied for the pupil acadc^sic scores. 
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In thd upper cohort, the pupil's reading test at the start of the year 
correlates lilth positive changes In the parent opinion scores for "^Llkes to 
Read** and **Serlou8 Reader*** Thus, there Is a tendency for pupils vho read 
better to develop more positive reading attitudes (as reported by parents) 
over the course of a year. Such a process. If It operates year after year, 
suggests that good attitudes come from good practices regarding reading. 
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